igt@xe_pat@pt-caching on shard-bmg@IGTPW

Detail	Value
Duration	unknown
Hostname	shard-bmg-3
Igt-Version	IGT-Version: 2.4-gaf22d703e (x86_64) (Linux: 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ x86_64)
Out	Using IGT_SRANDOM=1775795092 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 Subtest pt-caching: SUCCESS (13.197s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching Subtest pt-caching: SUCCESS (13.197s)
Dmesg Scroll to first warning	<6> [213.564296] Console: switching to colour dummy device 80x25 <6> [213.564613] [IGT] xe_pat: executing <6> [213.600946] [IGT] xe_pat: starting subtest pt-caching <7> [213.686814] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2 <7> [213.790790] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2 <6> [215.069930] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000000001790000 FaultType: 0 AccessType: 0 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [215.069945] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [215.069991] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [215.070724] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <6> [215.071230] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [215.071317] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64628, lrc_seqno=64628, guc_id=0, flags=0x73 in no process [-1] <6> [215.251105] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [215.251132] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [215.251135] ------------[ cut here ]------------ <4> [215.251137] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.251139] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:139/6171 <4> [215.251231] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.251297] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.251303] CPU: 0 UID: 0 PID: 6171 Comm: kworker/u64:139 Tainted: G S U 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.251305] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [215.251307] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.251308] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.251314] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.251393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.251395] RSP: 0018:ffffc9000dabfca0 EFLAGS: 00010246 <4> [215.251397] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.251399] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.251400] RBP: ffffc9000dabfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.251401] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.251402] R13: ffff888104bdee10 R14: ffff888139510000 R15: 00000000fffffffb <4> [215.251403] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [215.251405] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.251406] CR2: 00007aa4503ff000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [215.251407] PKRU: 55555554 <4> [215.251408] Call Trace: <4> [215.251409] <TASK> <4> [215.251413] ? lock_sync+0x100/0x100 <4> [215.251419] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [215.251424] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.251429] process_one_work+0x239/0x760 <4> [215.251436] worker_thread+0x200/0x3f0 <4> [215.251438] ? __pfx_worker_thread+0x10/0x10 <4> [215.251440] kthread+0x10d/0x150 <4> [215.251443] ? __pfx_kthread+0x10/0x10 <4> [215.251446] ret_from_fork+0x3d4/0x480 <4> [215.251449] ? __pfx_kthread+0x10/0x10 <4> [215.251452] ret_from_fork_asm+0x1a/0x30 <4> [215.251459] </TASK> <4> [215.251460] irq event stamp: 387313 <4> [215.251461] hardirqs last enabled at (387319): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.251464] hardirqs last disabled at (387324): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.251466] softirqs last enabled at (386468): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.251469] softirqs last disabled at (386445): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.251471] ---[ end trace 0000000000000000 ]--- <6> [215.251473] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.251538] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.251712] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.251724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.252048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.252131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.252218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.252302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.252382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.252459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.252536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.252615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.252690] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.252784] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.252903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.253907] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.263863] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.264132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.265563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.265643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.265714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.265796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.265874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.265951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.266023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.266092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.266161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.266228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.266295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.266365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.266435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.266504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.266571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.266638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.266704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.266772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.266858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.266942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.267024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.267102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.267174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.267245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.267316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.267385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.267454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.267529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.267604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.267676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.267748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.267836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.267921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.268005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.268088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.268166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.268245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.268327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.268407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.268487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.268567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.268644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.268721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.268799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.268879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.268955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.269031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.269107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.269189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.269267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.269345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.269425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.269502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.269579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.269656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.269736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.269837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.269914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.269996] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.270183] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.270199] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64628, lrc_seqno=64628, guc_id=0, flags=0x73 in no process [-1] <7> [215.270202] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.270261] ------------[ cut here ]------------ <4> [215.270262] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.270264] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:139/6171 <4> [215.270335] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.270403] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.270408] CPU: 10 UID: 0 PID: 6171 Comm: kworker/u64:139 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.270412] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.270413] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.270414] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.270420] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.270490] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.270492] RSP: 0018:ffffc9000dabfca0 EFLAGS: 00010246 <4> [215.270494] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.270496] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.270497] RBP: ffffc9000dabfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.270498] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.270499] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.270501] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.270503] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.270504] CR2: 00007dbbb955a008 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.270505] PKRU: 55555554 <4> [215.270507] Call Trace: <4> [215.270508] <TASK> <4> [215.270512] ? lock_sync+0x100/0x100 <4> [215.270517] ? lock_release+0xd0/0x2b0 <4> [215.270523] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.270528] process_one_work+0x239/0x760 <4> [215.270535] worker_thread+0x200/0x3f0 <4> [215.270538] ? __pfx_worker_thread+0x10/0x10 <4> [215.270540] kthread+0x10d/0x150 <4> [215.270543] ? __pfx_kthread+0x10/0x10 <4> [215.270546] ret_from_fork+0x3d4/0x480 <4> [215.270549] ? __pfx_kthread+0x10/0x10 <4> [215.270552] ret_from_fork_asm+0x1a/0x30 <4> [215.270560] </TASK> <4> [215.270561] irq event stamp: 390433 <4> [215.270562] hardirqs last enabled at (390439): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.270565] hardirqs last disabled at (390444): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.270568] softirqs last enabled at (389482): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.270570] softirqs last disabled at (389475): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.270573] ---[ end trace 0000000000000000 ]--- <6> [215.270575] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.270646] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.270652] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.272151] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.272273] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.272654] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.272871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.272963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.273056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.273144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.273232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.273321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.273409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.273496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.273578] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.273674] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.273794] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.274844] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.284789] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.285059] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.286130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.286211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.286290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.286375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.286459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.286534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.286608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.286684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.286760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.286850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.286923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.286996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.287069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.287142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.287216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.287287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.287361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.287435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.287507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.287588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.287670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.287750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.287843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.287924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.288002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.288078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.288155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.288232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.288311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.288389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.288466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.288543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.288628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.288715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.288805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.288886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.288966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.289043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.289120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.289195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.289274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.289350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.289425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.289499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.289578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.289657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.289737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.289821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.289898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.289974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.290051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.290129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.290207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.290283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.290357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.290435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.290510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.290585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.290662] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.290773] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.291736] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64628, lrc_seqno=64628, guc_id=0, flags=0x73 in no process [-1] <7> [215.291739] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [215.291962] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.292070] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [215.292171] ------------[ cut here ]------------ <4> [215.292173] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.292174] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:139/6171 <4> [215.292247] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.292315] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.292320] CPU: 10 UID: 0 PID: 6171 Comm: kworker/u64:139 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.292323] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.292324] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.292326] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.292331] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.292404] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.292405] RSP: 0018:ffffc9000dabfca0 EFLAGS: 00010246 <4> [215.292408] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.292409] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.292411] RBP: ffffc9000dabfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.292412] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.292413] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.292414] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.292416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.292417] CR2: 00007dbbb955a008 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.292419] PKRU: 55555554 <4> [215.292420] Call Trace: <4> [215.292421] <TASK> <4> [215.292425] ? lock_sync+0x100/0x100 <4> [215.292430] ? lock_release+0xd0/0x2b0 <4> [215.292436] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.292442] process_one_work+0x239/0x760 <4> [215.292448] worker_thread+0x200/0x3f0 <4> [215.292451] ? __pfx_worker_thread+0x10/0x10 <4> [215.292453] kthread+0x10d/0x150 <4> [215.292457] ? __pfx_kthread+0x10/0x10 <4> [215.292460] ret_from_fork+0x3d4/0x480 <4> [215.292463] ? __pfx_kthread+0x10/0x10 <4> [215.292466] ret_from_fork_asm+0x1a/0x30 <4> [215.292474] </TASK> <4> [215.292475] irq event stamp: 393597 <4> [215.292476] hardirqs last enabled at (393603): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.292479] hardirqs last disabled at (393608): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.292482] softirqs last enabled at (392826): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.292484] softirqs last disabled at (392815): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.292487] ---[ end trace 0000000000000000 ]--- <5> [215.293261] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64683, lrc_seqno=64683, guc_id=0, flags=0x73 in no process [-1] <7> [215.293265] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.293325] ------------[ cut here ]------------ <4> [215.293326] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.293328] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:139/6171 <4> [215.293401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.293479] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.293484] CPU: 10 UID: 0 PID: 6171 Comm: kworker/u64:139 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.293487] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.293488] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.293490] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.293495] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.293566] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.293568] RSP: 0018:ffffc9000dabfca0 EFLAGS: 00010246 <4> [215.293571] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.293572] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.293574] RBP: ffffc9000dabfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.293575] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.293577] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.293578] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.293580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.293582] CR2: 00007dbbb955a008 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.293584] PKRU: 55555554 <4> [215.293585] Call Trace: <4> [215.293586] <TASK> <4> [215.293590] ? lock_sync+0x100/0x100 <4> [215.293595] ? lock_release+0xd0/0x2b0 <4> [215.293601] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.293607] process_one_work+0x239/0x760 <4> [215.293613] worker_thread+0x200/0x3f0 <4> [215.293615] ? __pfx_worker_thread+0x10/0x10 <4> [215.293618] kthread+0x10d/0x150 <4> [215.293621] ? __pfx_kthread+0x10/0x10 <4> [215.293624] ret_from_fork+0x3d4/0x480 <4> [215.293627] ? __pfx_kthread+0x10/0x10 <4> [215.293630] ret_from_fork_asm+0x1a/0x30 <4> [215.293637] </TASK> <4> [215.293639] irq event stamp: 396223 <4> [215.293640] hardirqs last enabled at (396229): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.293643] hardirqs last disabled at (396234): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.293645] softirqs last enabled at (393994): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.293648] softirqs last disabled at (393987): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.293650] ---[ end trace 0000000000000000 ]--- <6> [215.293651] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.293722] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.293729] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.293906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.294131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.294224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.294317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.294404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.294489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.294572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.294657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.294743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.294837] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.294954] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.295072] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.296086] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.306787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.307042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.308151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.308232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.308309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.308385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.308462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.308539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.308616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.308695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.308772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.308865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.308958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.309056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.309154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.309252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.309351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.309449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.309547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.309643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.309738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.309865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.309956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.310038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.310121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.310200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.310278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.310354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.310431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.310511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.310594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.310679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.310759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.310851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.310935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.311018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.311103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.311187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.311268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.311346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.311424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.311500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.311578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.311655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.311731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.311814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.311893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.311970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.312046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.312122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.312198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.312274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.312352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.312435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.312515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.312593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.312669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.312745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.312831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.312905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.312985] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.313098] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.313103] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64683, lrc_seqno=64683, guc_id=0, flags=0x73 in no process [-1] <7> [215.313105] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.313165] ------------[ cut here ]------------ <4> [215.313166] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.313168] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:142/6174 <4> [215.313240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.313305] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.313310] CPU: 3 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.313313] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.313314] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.313315] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.313320] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.313390] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.313392] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.313394] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.313396] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.313397] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.313398] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.313399] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.313401] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [215.313402] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.313404] CR2: 0000592d0aac8c98 CR3: 000000013970b005 CR4: 0000000000f72ef0 <4> [215.313405] PKRU: 55555554 <4> [215.313406] Call Trace: <4> [215.313408] <TASK> <4> [215.313412] ? lock_sync+0x100/0x100 <4> [215.313416] ? lock_release+0xd0/0x2b0 <4> [215.313422] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.313427] process_one_work+0x239/0x760 <4> [215.313433] worker_thread+0x200/0x3f0 <4> [215.313436] ? __pfx_worker_thread+0x10/0x10 <4> [215.313438] kthread+0x10d/0x150 <4> [215.313441] ? __pfx_kthread+0x10/0x10 <4> [215.313445] ret_from_fork+0x3d4/0x480 <4> [215.313447] ? __pfx_kthread+0x10/0x10 <4> [215.313450] ret_from_fork_asm+0x1a/0x30 <4> [215.313458] </TASK> <4> [215.313459] irq event stamp: 700085 <4> [215.313460] hardirqs last enabled at (700091): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.313463] hardirqs last disabled at (700096): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.313465] softirqs last enabled at (698954): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.313467] softirqs last disabled at (698947): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.313470] ---[ end trace 0000000000000000 ]--- <6> [215.313472] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.313542] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.313548] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.314878] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.314983] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.315089] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.315298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.315391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.315485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.315573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.315659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.315744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.315841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.315931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.316015] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.316110] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.316223] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.317231] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.327785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.328036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.329284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.329362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.329437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.329514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.329590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.329665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.329739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.329836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.329912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.329988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.330062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.330135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.330207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.330281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.330354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.330427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.330500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.330572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.330644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.330726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.330817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.330897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.330976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.331053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.331132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.331211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.331288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.331367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.331445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.331523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.331601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.331679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.331765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.331865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.331951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.332033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.332112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.332188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.332265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.332340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.332420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.332499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.332575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.332650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.332730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.332820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.332900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.332978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.333057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.333133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.333209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.333288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.333365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.333441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.333518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.333596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.333672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.333746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.333833] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.334053] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.334058] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64683, lrc_seqno=64683, guc_id=0, flags=0x73 in no process [-1] <7> [215.334061] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.334124] ------------[ cut here ]------------ <4> [215.334126] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.334127] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:286/6318 <4> [215.334200] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.334265] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.334270] CPU: 6 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.334273] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.334274] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.334276] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.334281] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.334353] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.334355] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.334357] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.334358] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.334359] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.334361] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.334362] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.334363] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [215.334365] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.334366] CR2: 00007aa425a18000 CR3: 000000013970b001 CR4: 0000000000f72ef0 <4> [215.334368] PKRU: 55555554 <4> [215.334369] Call Trace: <4> [215.334370] <TASK> <4> [215.334374] ? lock_sync+0x100/0x100 <4> [215.334379] ? lock_release+0xd0/0x2b0 <4> [215.334384] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.334390] process_one_work+0x239/0x760 <4> [215.334396] worker_thread+0x200/0x3f0 <4> [215.334399] ? __pfx_worker_thread+0x10/0x10 <4> [215.334401] kthread+0x10d/0x150 <4> [215.334404] ? __pfx_kthread+0x10/0x10 <4> [215.334408] ret_from_fork+0x3d4/0x480 <4> [215.334410] ? __pfx_kthread+0x10/0x10 <4> [215.334413] ret_from_fork_asm+0x1a/0x30 <4> [215.334420] </TASK> <4> [215.334421] irq event stamp: 978913 <4> [215.334423] hardirqs last enabled at (978919): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.334425] hardirqs last disabled at (978924): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.334428] softirqs last enabled at (978064): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.334430] softirqs last disabled at (978053): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.334432] ---[ end trace 0000000000000000 ]--- <5> [215.335910] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64738, lrc_seqno=64738, guc_id=0, flags=0x73 in no process [-1] <7> [215.335914] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.335974] ------------[ cut here ]------------ <4> [215.335975] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.335977] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:286/6318 <4> [215.336046] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.336110] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.336114] CPU: 6 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.336117] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.336118] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.336120] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.336124] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.336192] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.336193] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.336195] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.336197] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.336198] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.336199] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.336200] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.336201] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [215.336203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.336204] CR2: 00007aa425a18000 CR3: 000000013970b001 CR4: 0000000000f72ef0 <4> [215.336206] PKRU: 55555554 <4> [215.336207] Call Trace: <4> [215.336208] <TASK> <4> [215.336212] ? lock_sync+0x100/0x100 <4> [215.336216] ? lock_release+0xd0/0x2b0 <4> [215.336221] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.336227] process_one_work+0x239/0x760 <4> [215.336233] worker_thread+0x200/0x3f0 <4> [215.336236] ? __pfx_worker_thread+0x10/0x10 <4> [215.336238] kthread+0x10d/0x150 <4> [215.336241] ? __pfx_kthread+0x10/0x10 <4> [215.336245] ret_from_fork+0x3d4/0x480 <4> [215.336246] ? __pfx_kthread+0x10/0x10 <4> [215.336250] ret_from_fork_asm+0x1a/0x30 <4> [215.336257] </TASK> <4> [215.336258] irq event stamp: 981591 <4> [215.336259] hardirqs last enabled at (981597): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.336262] hardirqs last disabled at (981602): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.336264] softirqs last enabled at (979842): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.336266] softirqs last disabled at (979835): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.336268] ---[ end trace 0000000000000000 ]--- <6> [215.336270] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.336339] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.336345] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.336406] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.336508] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.336615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.336825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.336915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.337008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.337095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.337179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.337264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.337347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.337433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.337514] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.337609] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.337726] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.338752] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.348786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.349066] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.350109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.350187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.350265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.350343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.350419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.350495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.350569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.350644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.350718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.350797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.350875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.350949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.351023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.351096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.351170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.351246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.351320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.351394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.351468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.351550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.351630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.351709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.351803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.351881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.351961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.352039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.352115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.352194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.352273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.352351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.352428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.352505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.352587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.352669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.352752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.352842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.352924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.353004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.353082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.353158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.353236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.353313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.353389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.353464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.353545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.353621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.353697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.353771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.353862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.353936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.354010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.354088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.354164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.354246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.354324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.354402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.354478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.354554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.354632] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.354744] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.354748] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64738, lrc_seqno=64738, guc_id=0, flags=0x73 in no process [-1] <7> [215.354750] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.355674] ------------[ cut here ]------------ <4> [215.355676] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.355677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:286/6318 <4> [215.355750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.355844] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.355849] CPU: 6 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.355852] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.355853] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.355854] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.355860] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.355929] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.355931] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.355933] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.355935] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.355936] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.355937] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.355938] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.355940] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [215.355942] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.355944] CR2: 00007aa425a18000 CR3: 000000016baa0006 CR4: 0000000000f72ef0 <4> [215.355945] PKRU: 55555554 <4> [215.355946] Call Trace: <4> [215.355947] <TASK> <4> [215.355951] ? lock_sync+0x100/0x100 <4> [215.355955] ? lock_release+0xd0/0x2b0 <4> [215.355961] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.355966] process_one_work+0x239/0x760 <4> [215.355972] worker_thread+0x200/0x3f0 <4> [215.355975] ? __pfx_worker_thread+0x10/0x10 <4> [215.355977] kthread+0x10d/0x150 <4> [215.355980] ? __pfx_kthread+0x10/0x10 <4> [215.355984] ret_from_fork+0x3d4/0x480 <4> [215.355986] ? __pfx_kthread+0x10/0x10 <4> [215.355989] ret_from_fork_asm+0x1a/0x30 <4> [215.355997] </TASK> <4> [215.355998] irq event stamp: 984749 <4> [215.355999] hardirqs last enabled at (984755): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.356002] hardirqs last disabled at (984760): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.356004] softirqs last enabled at (983734): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.356007] softirqs last disabled at (983727): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.356009] ---[ end trace 0000000000000000 ]--- <6> [215.356011] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.356079] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.356086] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.356098] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.356201] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.356497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.356716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.356828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.356928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.357021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.357112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.357202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.357295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.357390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.357479] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.357581] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.357704] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.358717] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.368785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.369040] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.370130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.370216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.370297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.370379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.370459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.370539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.370619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.370698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.370781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.370862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.370943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.371024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.371104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.371181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.371260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.371338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.371417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.371495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.371573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.371659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.371745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.371841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.371928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.372011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.372097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.372178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.372261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.372346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.372431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.372514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.372596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.372678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.372766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.372869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.372961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.373047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.373133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.373215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.373296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.373376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.373460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.373542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.373624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.373703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.373790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.373872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.373953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.374035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.374120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.374202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.374283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.374367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.374448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.374530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.374614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.374700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.374784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.374866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.374950] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.375064] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.375069] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64738, lrc_seqno=64738, guc_id=0, flags=0x73 in no process [-1] <7> [215.375071] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.375133] ------------[ cut here ]------------ <4> [215.375134] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.375135] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:143/6175 <4> [215.375211] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.375277] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.375281] CPU: 4 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.375285] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.375286] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.375287] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.375293] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.375367] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.375369] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.375372] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.375373] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.375374] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.375376] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.375377] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.375378] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [215.375380] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.375381] CR2: 00007aa4565e61b4 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [215.375383] PKRU: 55555554 <4> [215.375384] Call Trace: <4> [215.375385] <TASK> <4> [215.375389] ? lock_sync+0x100/0x100 <4> [215.375394] ? lock_release+0xd0/0x2b0 <4> [215.375399] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.375405] process_one_work+0x239/0x760 <4> [215.375411] worker_thread+0x200/0x3f0 <4> [215.375414] ? __pfx_worker_thread+0x10/0x10 <4> [215.375416] kthread+0x10d/0x150 <4> [215.375419] ? __pfx_kthread+0x10/0x10 <4> [215.375423] ret_from_fork+0x3d4/0x480 <4> [215.375425] ? __pfx_kthread+0x10/0x10 <4> [215.375429] ret_from_fork_asm+0x1a/0x30 <4> [215.375436] </TASK> <4> [215.375437] irq event stamp: 1642469 <4> [215.375438] hardirqs last enabled at (1642475): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.375441] hardirqs last disabled at (1642480): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.375443] softirqs last enabled at (1641440): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.375446] softirqs last disabled at (1641433): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.375448] ---[ end trace 0000000000000000 ]--- <7> [215.376792] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.376911] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [215.377165] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64793, lrc_seqno=64793, guc_id=0, flags=0x73 in no process [-1] <7> [215.377170] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.377234] ------------[ cut here ]------------ <4> [215.377235] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.377237] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:142/6174 <4> [215.377312] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.377376] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.377381] CPU: 3 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.377384] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.377385] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.377387] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.377392] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.377461] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.377463] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.377465] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.377467] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.377468] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.377469] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.377470] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.377472] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [215.377473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.377475] CR2: 0000592d0aac8c98 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [215.377476] PKRU: 55555554 <4> [215.377477] Call Trace: <4> [215.377478] <TASK> <4> [215.377482] ? lock_sync+0x100/0x100 <4> [215.377487] ? lock_release+0xd0/0x2b0 <4> [215.377492] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.377498] process_one_work+0x239/0x760 <4> [215.377504] worker_thread+0x200/0x3f0 <4> [215.377507] ? __pfx_worker_thread+0x10/0x10 <4> [215.377509] kthread+0x10d/0x150 <4> [215.377512] ? __pfx_kthread+0x10/0x10 <4> [215.377516] ret_from_fork+0x3d4/0x480 <4> [215.377518] ? __pfx_kthread+0x10/0x10 <4> [215.377521] ret_from_fork_asm+0x1a/0x30 <4> [215.377528] </TASK> <4> [215.377529] irq event stamp: 705609 <4> [215.377531] hardirqs last enabled at (705615): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.377534] hardirqs last disabled at (705620): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.377536] softirqs last enabled at (702796): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.377538] softirqs last disabled at (702789): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.377540] ---[ end trace 0000000000000000 ]--- <6> [215.377542] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.377612] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.377618] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.377666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.377879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.377974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.378073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.378166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.378258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.378347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.378437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.378528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.378613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.378710] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.378848] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.379883] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.389785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.390059] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.391126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.391204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.391277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.391352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.391426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.391500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.391574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.391652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.391729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.391830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.391905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.391980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.392054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.392129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.392202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.392277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.392350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.392423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.392495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.392577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.392658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.392740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.392845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.392926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.393003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.393081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.393158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.393236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.393316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.393395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.393473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.393551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.393636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.393719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.393805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.393885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.393965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.394040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.394117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.394191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.394269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.394346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.394422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.394497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.394577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.394656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.394737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.394821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.394899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.394975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.395050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.395128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.395204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.395280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.395355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.395431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.395505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.395580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.395658] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.395769] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.395773] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64793, lrc_seqno=64793, guc_id=0, flags=0x73 in no process [-1] <7> [215.395775] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.396703] ------------[ cut here ]------------ <4> [215.396704] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.396705] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:143/6175 <4> [215.396776] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.396855] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.396860] CPU: 4 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.396863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.396865] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.396866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.396872] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.396941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.396943] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.396946] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.396947] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.396949] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.396950] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.396952] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.396953] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [215.396955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.396957] CR2: 00007aa4565e61b4 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [215.396958] PKRU: 55555554 <4> [215.396960] Call Trace: <4> [215.396961] <TASK> <4> [215.396965] ? lock_sync+0x100/0x100 <4> [215.396969] ? lock_release+0xd0/0x2b0 <4> [215.396975] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.396981] process_one_work+0x239/0x760 <4> [215.396987] worker_thread+0x200/0x3f0 <4> [215.396990] ? __pfx_worker_thread+0x10/0x10 <4> [215.396992] kthread+0x10d/0x150 <4> [215.396995] ? __pfx_kthread+0x10/0x10 <4> [215.396998] ret_from_fork+0x3d4/0x480 <4> [215.397000] ? __pfx_kthread+0x10/0x10 <4> [215.397004] ret_from_fork_asm+0x1a/0x30 <4> [215.397011] </TASK> <4> [215.397012] irq event stamp: 1647173 <4> [215.397013] hardirqs last enabled at (1647179): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.397016] hardirqs last disabled at (1647184): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.397018] softirqs last enabled at (1646430): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.397021] softirqs last disabled at (1646423): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.397023] ---[ end trace 0000000000000000 ]--- <7> [215.397035] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.397139] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [215.397237] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.397308] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.397314] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.397725] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.397954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.398047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.398143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.398236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.398326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.398412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.398498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.398587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.398671] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.398766] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.398894] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.399914] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.409785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.410060] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.411101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.411178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.411253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.411329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.411408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.411484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.411558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.411632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.411706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.411785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.411862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.411936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.412010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.412084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.412157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.412230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.412303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.412377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.412453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.412536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.412617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.412694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.412775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.412866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.412944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.413021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.413097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.413177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.413256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.413334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.413412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.413491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.413575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.413657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.413740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.413829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.413911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.413991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.414069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.414145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.414223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.414301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.414377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.414452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.414531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.414606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.414682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.414757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.414841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.414915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.414989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.415067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.415146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.415226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.415304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.415383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.415457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.415532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.415609] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.415721] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.415725] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64793, lrc_seqno=64793, guc_id=0, flags=0x73 in no process [-1] <7> [215.415727] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.415794] ------------[ cut here ]------------ <4> [215.415796] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.415797] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.415871] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.415936] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.415941] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.415944] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.415945] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.415947] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.415952] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.416022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.416024] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.416026] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.416027] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.416029] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.416030] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.416031] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.416032] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.416034] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.416035] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.416037] PKRU: 55555554 <4> [215.416038] Call Trace: <4> [215.416039] <TASK> <4> [215.416043] ? lock_sync+0x100/0x100 <4> [215.416048] ? lock_release+0xd0/0x2b0 <4> [215.416053] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.416059] process_one_work+0x239/0x760 <4> [215.416066] worker_thread+0x200/0x3f0 <4> [215.416068] ? __pfx_worker_thread+0x10/0x10 <4> [215.416071] kthread+0x10d/0x150 <4> [215.416074] ? __pfx_kthread+0x10/0x10 <4> [215.416077] ret_from_fork+0x3d4/0x480 <4> [215.416079] ? __pfx_kthread+0x10/0x10 <4> [215.416083] ret_from_fork_asm+0x1a/0x30 <4> [215.416090] </TASK> <4> [215.416091] irq event stamp: 989433 <4> [215.416092] hardirqs last enabled at (989439): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.416095] hardirqs last disabled at (989444): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.416097] softirqs last enabled at (988424): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.416100] softirqs last disabled at (988417): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.416102] ---[ end trace 0000000000000000 ]--- <5> [215.416696] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64848, lrc_seqno=64848, guc_id=0, flags=0x73 in no process [-1] <7> [215.416699] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.416758] ------------[ cut here ]------------ <4> [215.416759] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.416760] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.416868] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.416932] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.416937] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.416939] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.416940] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.416942] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.416946] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.417015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.417016] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.417018] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.417020] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.417021] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.417022] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.417023] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.417024] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.417026] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.417027] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.417029] PKRU: 55555554 <4> [215.417030] Call Trace: <4> [215.417031] <TASK> <4> [215.417035] ? lock_sync+0x100/0x100 <4> [215.417039] ? lock_release+0xd0/0x2b0 <4> [215.417044] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.417050] process_one_work+0x239/0x760 <4> [215.417056] worker_thread+0x200/0x3f0 <4> [215.417059] ? __pfx_worker_thread+0x10/0x10 <4> [215.417061] kthread+0x10d/0x150 <4> [215.417064] ? __pfx_kthread+0x10/0x10 <4> [215.417068] ret_from_fork+0x3d4/0x480 <4> [215.417070] ? __pfx_kthread+0x10/0x10 <4> [215.417073] ret_from_fork_asm+0x1a/0x30 <4> [215.417081] </TASK> <4> [215.417082] irq event stamp: 992067 <4> [215.417083] hardirqs last enabled at (992073): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.417085] hardirqs last disabled at (992078): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.417087] softirqs last enabled at (991318): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.417090] softirqs last disabled at (991301): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.417092] ---[ end trace 0000000000000000 ]--- <6> [215.417862] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.418004] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.418015] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.418010] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.418114] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.418284] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.418546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.418682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.418833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.418924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.419014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.419103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.419192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.419278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.419360] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.419454] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.419571] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.420582] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.430786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.431057] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.432145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.432226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.432303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.432379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.432454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.432532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.432608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.432683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.432757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.432842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.432916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.432989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.433062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.433135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.433208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.433280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.433353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.433426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.433499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.433580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.433662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.433739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.433828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.433905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.433980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.434056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.434135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.434215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.434295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.434373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.434452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.434530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.434614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.434700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.434792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.434883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.434963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.435041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.435119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.435194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.435272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.435352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.435432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.435511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.435592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.435669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.435746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.435829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.435906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.435980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.436056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.436138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.436217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.436295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.436371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.436448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.436523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.436598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.436677] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.436793] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.436797] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64848, lrc_seqno=64848, guc_id=0, flags=0x73 in no process [-1] <7> [215.436800] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.436875] ------------[ cut here ]------------ <4> [215.436876] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.436877] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.436949] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.437012] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.437016] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.437019] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.437020] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.437021] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.437026] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.437096] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.437097] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.437100] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.437101] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.437102] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.437103] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.437104] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.437106] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.437107] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.437109] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.437110] PKRU: 55555554 <4> [215.437111] Call Trace: <4> [215.437112] <TASK> <4> [215.437116] ? lock_sync+0x100/0x100 <4> [215.437120] ? lock_release+0xd0/0x2b0 <4> [215.437126] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.437131] process_one_work+0x239/0x760 <4> [215.437137] worker_thread+0x200/0x3f0 <4> [215.437140] ? __pfx_worker_thread+0x10/0x10 <4> [215.437142] kthread+0x10d/0x150 <4> [215.437145] ? __pfx_kthread+0x10/0x10 <4> [215.437149] ret_from_fork+0x3d4/0x480 <4> [215.437151] ? __pfx_kthread+0x10/0x10 <4> [215.437154] ret_from_fork_asm+0x1a/0x30 <4> [215.437161] </TASK> <4> [215.437162] irq event stamp: 995187 <4> [215.437164] hardirqs last enabled at (995193): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.437166] hardirqs last disabled at (995198): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.437168] softirqs last enabled at (994386): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.437171] softirqs last disabled at (994373): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.437173] ---[ end trace 0000000000000000 ]--- <6> [215.437175] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.437245] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.437251] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.438513] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.438616] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.438722] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.438956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.439049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.439143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.439231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.439319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.439408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.439495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.439582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.439664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.439757] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.439909] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.440928] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.451652] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.451913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.452949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.453029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.453104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.453182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.453258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.453332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.453406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.453482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.453556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.453630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.453704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.453784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.453869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.453943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.454016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.454088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.454161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.454233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.454306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.454387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.454469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.454549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.454629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.454706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.454791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.454878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.454955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.455034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.455113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.455191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.455272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.455352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.455438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.455523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.455607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.455688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.455771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.455871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.455959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.456037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.456116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.456193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.456270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.456346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.456426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.456502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.456579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.456659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.456739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.456828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.456914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.456993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.457070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.457147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.457223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.457300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.457374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.457449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.457527] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.457640] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.457645] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64848, lrc_seqno=64848, guc_id=0, flags=0x73 in no process [-1] <7> [215.457647] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.457705] ------------[ cut here ]------------ <4> [215.457706] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.457708] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:142/6174 <4> [215.457784] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.457870] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.457875] CPU: 3 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.457878] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.457880] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.457881] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.457886] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.457958] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.457959] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.457962] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.457963] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.457965] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.457966] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.457967] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.457968] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [215.457970] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.457971] CR2: 0000592d0aac8c98 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [215.457973] PKRU: 55555554 <4> [215.457974] Call Trace: <4> [215.457975] <TASK> <4> [215.457979] ? lock_sync+0x100/0x100 <4> [215.457984] ? lock_release+0xd0/0x2b0 <4> [215.457989] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.457995] process_one_work+0x239/0x760 <4> [215.458001] worker_thread+0x200/0x3f0 <4> [215.458004] ? __pfx_worker_thread+0x10/0x10 <4> [215.458006] kthread+0x10d/0x150 <4> [215.458009] ? __pfx_kthread+0x10/0x10 <4> [215.458013] ret_from_fork+0x3d4/0x480 <4> [215.458015] ? __pfx_kthread+0x10/0x10 <4> [215.458018] ret_from_fork_asm+0x1a/0x30 <4> [215.458025] </TASK> <4> [215.458026] irq event stamp: 709013 <4> [215.458028] hardirqs last enabled at (709019): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.458030] hardirqs last disabled at (709024): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.458033] softirqs last enabled at (708020): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.458035] softirqs last disabled at (708011): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.458038] ---[ end trace 0000000000000000 ]--- <5> [215.458665] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64903, lrc_seqno=64903, guc_id=0, flags=0x73 in no process [-1] <7> [215.458667] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.458727] ------------[ cut here ]------------ <4> [215.458728] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.458729] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:142/6174 <4> [215.458815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.458894] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.458899] CPU: 3 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.458901] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.458903] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.458904] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.458909] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.458976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.458978] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.458980] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.458981] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.458983] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.458984] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.458985] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.458986] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [215.458988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.458989] CR2: 0000592d0aac8c98 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [215.458990] PKRU: 55555554 <4> [215.458992] Call Trace: <4> [215.458993] <TASK> <4> [215.458996] ? lock_sync+0x100/0x100 <4> [215.459000] ? lock_release+0xd0/0x2b0 <4> [215.459006] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.459011] process_one_work+0x239/0x760 <4> [215.459017] worker_thread+0x200/0x3f0 <4> [215.459020] ? __pfx_worker_thread+0x10/0x10 <4> [215.459022] kthread+0x10d/0x150 <4> [215.459025] ? __pfx_kthread+0x10/0x10 <4> [215.459029] ret_from_fork+0x3d4/0x480 <4> [215.459030] ? __pfx_kthread+0x10/0x10 <4> [215.459034] ret_from_fork_asm+0x1a/0x30 <4> [215.459041] </TASK> <4> [215.459042] irq event stamp: 711693 <4> [215.459043] hardirqs last enabled at (711699): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.459046] hardirqs last disabled at (711704): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.459048] softirqs last enabled at (710944): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.459050] softirqs last disabled at (710933): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.459053] ---[ end trace 0000000000000000 ]--- <6> [215.459811] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.459947] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.459959] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.459968] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.460077] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.460248] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.460510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.460646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.460792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.460934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.461029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.461118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.461205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.461295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.461381] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.461477] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.461592] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.462612] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.472789] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.473056] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.474070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.474151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.474227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.474304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.474380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.474455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.474529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.474604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.474681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.474757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.474866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.474942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.475016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.475089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.475163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.475236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.475311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.475386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.475463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.475545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.475625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.475703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.475788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.475870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.475948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.476026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.476102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.476182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.476263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.476341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.476420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.476499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.476582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.476669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.476756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.476849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.476930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.477007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.477083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.477157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.477236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.477317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.477397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.477474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.477554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.477630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.477707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.477785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.477861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.477935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.478010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.478087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.478162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.478239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.478319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.478399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.478474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.478548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.478626] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.478738] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.478742] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64903, lrc_seqno=64903, guc_id=0, flags=0x73 in no process [-1] <7> [215.478745] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.478834] ------------[ cut here ]------------ <4> [215.478835] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.478836] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:142/6174 <4> [215.478908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.478975] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.478980] CPU: 2 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.478983] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.478984] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.478986] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.478991] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.479061] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.479062] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.479065] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.479066] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.479067] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.479069] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.479070] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.479071] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.479073] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.479074] CR2: 00007b785fbdf000 CR3: 000000013970b006 CR4: 0000000000f72ef0 <4> [215.479075] PKRU: 55555554 <4> [215.479077] Call Trace: <4> [215.479078] <TASK> <4> [215.479082] ? lock_sync+0x100/0x100 <4> [215.479086] ? lock_release+0xd0/0x2b0 <4> [215.479092] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.479098] process_one_work+0x239/0x760 <4> [215.479104] worker_thread+0x200/0x3f0 <4> [215.479106] ? __pfx_worker_thread+0x10/0x10 <4> [215.479109] kthread+0x10d/0x150 <4> [215.479112] ? __pfx_kthread+0x10/0x10 <4> [215.479115] ret_from_fork+0x3d4/0x480 <4> [215.479117] ? __pfx_kthread+0x10/0x10 <4> [215.479121] ret_from_fork_asm+0x1a/0x30 <4> [215.479128] </TASK> <4> [215.479129] irq event stamp: 714817 <4> [215.479130] hardirqs last enabled at (714823): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.479133] hardirqs last disabled at (714828): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.479135] softirqs last enabled at (713808): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.479138] softirqs last disabled at (713799): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.479140] ---[ end trace 0000000000000000 ]--- <6> [215.479142] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.479212] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.479218] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.479624] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.479832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.479921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.480013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.480099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.480186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.480271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.480360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.480449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.480531] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.480625] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.480740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.481750] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.492481] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.492730] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.493809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.493887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.493963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.494038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.494113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.494187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.494262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.494335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.494408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.494480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.494553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.494625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.494697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.494769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.494879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.494953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.495026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.495103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.495178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.495258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.495337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.495413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.495491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.495567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.495643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.495719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.495798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.495877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.495956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.496034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.496112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.496190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.496277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.496364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.496451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.496532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.496612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.496689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.496767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.496856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.496935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.497011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.497087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.497161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.497239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.497315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.497392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.497466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.497543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.497618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.497696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.497780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.497859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.497936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.498012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.498090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.498165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.498240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.498317] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.498428] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.498432] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64903, lrc_seqno=64903, guc_id=0, flags=0x73 in no process [-1] <7> [215.498435] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.498492] ------------[ cut here ]------------ <4> [215.498494] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.498495] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:142/6174 <4> [215.498567] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.498629] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.498634] CPU: 2 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.498637] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.498638] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.498639] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.498644] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.498714] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.498715] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.498717] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.498719] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.498720] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.498721] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.498722] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.498724] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.498725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.498727] CR2: 00007b785fbdf000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.498728] PKRU: 55555554 <4> [215.498729] Call Trace: <4> [215.498730] <TASK> <4> [215.498734] ? lock_sync+0x100/0x100 <4> [215.498738] ? lock_release+0xd0/0x2b0 <4> [215.498744] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.498749] process_one_work+0x239/0x760 <4> [215.498755] worker_thread+0x200/0x3f0 <4> [215.498758] ? __pfx_worker_thread+0x10/0x10 <4> [215.498760] kthread+0x10d/0x150 <4> [215.498763] ? __pfx_kthread+0x10/0x10 <4> [215.498767] ret_from_fork+0x3d4/0x480 <4> [215.498769] ? __pfx_kthread+0x10/0x10 <4> [215.498772] ret_from_fork_asm+0x1a/0x30 <4> [215.498783] </TASK> <4> [215.498784] irq event stamp: 717931 <4> [215.498785] hardirqs last enabled at (717937): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.498788] hardirqs last disabled at (717942): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.498790] softirqs last enabled at (716952): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.498793] softirqs last disabled at (716947): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.498795] ---[ end trace 0000000000000000 ]--- <5> [215.500320] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64958, lrc_seqno=64958, guc_id=0, flags=0x73 in no process [-1] <7> [215.500323] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.500384] ------------[ cut here ]------------ <4> [215.500385] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.500386] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:142/6174 <4> [215.500456] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.500517] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.500522] CPU: 2 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.500524] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.500525] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.500526] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.500531] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.500600] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.500601] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.500603] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.500605] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.500606] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.500607] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.500608] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.500609] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.500611] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.500612] CR2: 00007b785fbdf000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.500613] PKRU: 55555554 <4> [215.500615] Call Trace: <4> [215.500616] <TASK> <4> [215.500619] ? lock_sync+0x100/0x100 <4> [215.500623] ? lock_release+0xd0/0x2b0 <4> [215.500629] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.500634] process_one_work+0x239/0x760 <4> [215.500640] worker_thread+0x200/0x3f0 <4> [215.500643] ? __pfx_worker_thread+0x10/0x10 <4> [215.500645] kthread+0x10d/0x150 <4> [215.500648] ? __pfx_kthread+0x10/0x10 <4> [215.500652] ret_from_fork+0x3d4/0x480 <4> [215.500653] ? __pfx_kthread+0x10/0x10 <4> [215.500657] ret_from_fork_asm+0x1a/0x30 <4> [215.500664] </TASK> <4> [215.500665] irq event stamp: 720629 <4> [215.500666] hardirqs last enabled at (720635): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.500669] hardirqs last disabled at (720640): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.500671] softirqs last enabled at (718056): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.500673] softirqs last disabled at (718049): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.500675] ---[ end trace 0000000000000000 ]--- <6> [215.500677] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.500744] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.500750] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.500764] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.500881] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.500998] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.501205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.501295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.501387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.501474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.501559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.501643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.501728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.501848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.501934] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.502030] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.502146] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.503157] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.513785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.514061] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.515125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.515206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.515283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.515359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.515434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.515509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.515584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.515657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.515731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.515827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.515901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.515975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.516049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.516122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.516196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.516269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.516342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.516415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.516487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.516567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.516648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.516729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.516833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.516911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.516988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.517064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.517140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.517218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.517296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.517373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.517451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.517528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.517614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.517700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.517788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.517871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.517951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.518027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.518104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.518179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.518256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.518333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.518412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.518490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.518572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.518651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.518727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.518829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.518907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.518983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.519058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.519136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.519212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.519289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.519368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.519449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.519526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.519601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.519679] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.520091] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.520111] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64958, lrc_seqno=64958, guc_id=0, flags=0x73 in no process [-1] <7> [215.520113] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.520172] ------------[ cut here ]------------ <4> [215.520174] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.520175] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.520246] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.520310] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.520316] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.520319] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.520320] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.520321] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.520326] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.520397] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.520399] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.520401] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.520403] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.520404] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.520405] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.520406] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.520407] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.520409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.520410] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.520412] PKRU: 55555554 <4> [215.520413] Call Trace: <4> [215.520414] <TASK> <4> [215.520418] ? lock_sync+0x100/0x100 <4> [215.520422] ? lock_release+0xd0/0x2b0 <4> [215.520428] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.520433] process_one_work+0x239/0x760 <4> [215.520439] worker_thread+0x200/0x3f0 <4> [215.520442] ? __pfx_worker_thread+0x10/0x10 <4> [215.520444] kthread+0x10d/0x150 <4> [215.520447] ? __pfx_kthread+0x10/0x10 <4> [215.520451] ret_from_fork+0x3d4/0x480 <4> [215.520453] ? __pfx_kthread+0x10/0x10 <4> [215.520456] ret_from_fork_asm+0x1a/0x30 <4> [215.520463] </TASK> <4> [215.520464] irq event stamp: 1001033 <4> [215.520465] hardirqs last enabled at (1001039): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.520468] hardirqs last disabled at (1001044): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.520470] softirqs last enabled at (1000206): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.520473] softirqs last disabled at (1000201): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.520475] ---[ end trace 0000000000000000 ]--- <6> [215.520477] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.520548] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.520554] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.520966] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.521167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.521255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.521347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.521435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.521521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.521609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.521698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.521791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.521875] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.521970] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.522086] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.523090] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.533798] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.534046] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.535126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.535204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.535280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.535356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.535431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.535506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.535581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.535656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.535729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.535810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.535884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.535958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.536034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.536109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.536184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.536256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.536333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.536405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.536478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.536558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.536641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.536723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.536809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.536888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.536966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.537045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.537123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.537203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.537283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.537361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.537439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.537520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.537607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.537693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.537781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.537862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.537941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.538018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.538095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.538175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.538257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.538336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.538414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.538490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.538571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.538651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.538730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.538814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.538893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.538968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.539043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.539121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.539197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.539272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.539346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.539423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.539497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.539573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.539651] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.539761] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.539765] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=64958, lrc_seqno=64958, guc_id=0, flags=0x73 in no process [-1] <7> [215.539767] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.540692] ------------[ cut here ]------------ <4> [215.540693] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.540694] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.540767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.540834] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.540838] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.540841] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.540842] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.540844] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.540849] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.540918] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.540919] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.540922] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.540923] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.540924] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.540926] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.540927] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.540928] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.540930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.540931] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.540933] PKRU: 55555554 <4> [215.540934] Call Trace: <4> [215.540935] <TASK> <4> [215.540939] ? lock_sync+0x100/0x100 <4> [215.540943] ? lock_release+0xd0/0x2b0 <4> [215.540948] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.540954] process_one_work+0x239/0x760 <4> [215.540960] worker_thread+0x200/0x3f0 <4> [215.540963] ? __pfx_worker_thread+0x10/0x10 <4> [215.540965] kthread+0x10d/0x150 <4> [215.540968] ? __pfx_kthread+0x10/0x10 <4> [215.540972] ret_from_fork+0x3d4/0x480 <4> [215.540974] ? __pfx_kthread+0x10/0x10 <4> [215.540977] ret_from_fork_asm+0x1a/0x30 <4> [215.540984] </TASK> <4> [215.540986] irq event stamp: 1004163 <4> [215.540987] hardirqs last enabled at (1004169): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.540989] hardirqs last disabled at (1004174): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.540992] softirqs last enabled at (1003236): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.540994] softirqs last disabled at (1003229): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.540996] ---[ end trace 0000000000000000 ]--- <7> [215.541008] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.541110] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [215.541796] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65013, lrc_seqno=65013, guc_id=0, flags=0x73 in no process [-1] <7> [215.541798] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.541859] ------------[ cut here ]------------ <4> [215.541860] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.541861] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.541933] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.541995] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.541999] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.542002] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.542003] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.542004] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.542009] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.542079] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.542081] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.542083] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.542084] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.542086] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.542087] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.542088] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.542089] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.542091] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.542092] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.542093] PKRU: 55555554 <4> [215.542095] Call Trace: <4> [215.542096] <TASK> <4> [215.542099] ? lock_sync+0x100/0x100 <4> [215.542103] ? lock_release+0xd0/0x2b0 <4> [215.542109] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.542114] process_one_work+0x239/0x760 <4> [215.542120] worker_thread+0x200/0x3f0 <4> [215.542123] ? __pfx_worker_thread+0x10/0x10 <4> [215.542125] kthread+0x10d/0x150 <4> [215.542128] ? __pfx_kthread+0x10/0x10 <4> [215.542132] ret_from_fork+0x3d4/0x480 <4> [215.542134] ? __pfx_kthread+0x10/0x10 <4> [215.542137] ret_from_fork_asm+0x1a/0x30 <4> [215.542144] </TASK> <4> [215.542145] irq event stamp: 1006835 <4> [215.542146] hardirqs last enabled at (1006841): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.542149] hardirqs last disabled at (1006846): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.542151] softirqs last enabled at (1003236): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.542154] softirqs last disabled at (1003229): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.542156] ---[ end trace 0000000000000000 ]--- <6> [215.542157] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.542228] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.542234] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.542477] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.542686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.542783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.542878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.542967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.543053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.543138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.543225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.543312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.543395] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.543490] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.543608] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.544619] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.554786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.555039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.556129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.556206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.556276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.556347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.556416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.556485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.556552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.556619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.556687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.556754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.556836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.556910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.556983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.557057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.557130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.557203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.557275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.557347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.557419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.557500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.557582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.557664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.557744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.557831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.557906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.557980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.558056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.558134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.558212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.558288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.558367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.558444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.558528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.558610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.558693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.558773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.558882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.558960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.559037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.559111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.559191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.559269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.559350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.559432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.559516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.559594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.559672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.559749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.559836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.559916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.559993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.560072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.560148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.560227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.560302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.560379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.560454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.560529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.560608] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.560719] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.560724] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65013, lrc_seqno=65013, guc_id=0, flags=0x73 in no process [-1] <7> [215.560726] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.561637] ------------[ cut here ]------------ <4> [215.561639] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.561640] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:142/6174 <4> [215.561714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.561783] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.561788] CPU: 2 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.561791] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.561792] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.561794] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.561800] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.561870] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.561871] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.561874] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.561875] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.561876] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.561878] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.561879] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.561880] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.561882] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.561883] CR2: 00007b785fbe0000 CR3: 0000000136f7e003 CR4: 0000000000f72ef0 <4> [215.561885] PKRU: 55555554 <4> [215.561886] Call Trace: <4> [215.561887] <TASK> <4> [215.561891] ? lock_sync+0x100/0x100 <4> [215.561895] ? lock_release+0xd0/0x2b0 <4> [215.561901] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.561906] process_one_work+0x239/0x760 <4> [215.561912] worker_thread+0x200/0x3f0 <4> [215.561915] ? __pfx_worker_thread+0x10/0x10 <4> [215.561917] kthread+0x10d/0x150 <4> [215.561920] ? __pfx_kthread+0x10/0x10 <4> [215.561924] ret_from_fork+0x3d4/0x480 <4> [215.561926] ? __pfx_kthread+0x10/0x10 <4> [215.561929] ret_from_fork_asm+0x1a/0x30 <4> [215.561936] </TASK> <4> [215.561938] irq event stamp: 726193 <4> [215.561939] hardirqs last enabled at (726199): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.561942] hardirqs last disabled at (726204): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.561944] softirqs last enabled at (725272): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.561946] softirqs last disabled at (725265): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.561949] ---[ end trace 0000000000000000 ]--- <7> [215.561962] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.562066] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [215.562164] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.562235] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.562241] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.562653] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.562866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.562957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.563051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.563139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.563224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.563309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.563393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.563479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.563560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.563654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.563772] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.564796] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.574785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.575035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.576076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.576156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.576232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.576308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.576384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.576459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.576534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.576608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.576681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.576754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.576837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.576914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.576988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.577062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.577136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.577208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.577280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.577353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.577425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.577507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.577587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.577667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.577746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.577833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.577912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.577991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.578069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.578152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.578234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.578314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.578394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.578473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.578557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.578641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.578729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.578820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.578900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.578978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.579055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.579130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.579208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.579285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.579361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.579436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.579516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.579591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.579667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.579743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.579831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.579910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.579987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.580069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.580149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.580228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.580306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.580383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.580459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.580534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.580613] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.580726] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.580730] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65013, lrc_seqno=65013, guc_id=0, flags=0x73 in no process [-1] <7> [215.580732] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.580800] ------------[ cut here ]------------ <4> [215.580801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.580802] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:143/6175 <4> [215.580873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.580938] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.580943] CPU: 10 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.580946] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.580947] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.580948] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.580954] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.581023] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.581025] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.581027] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.581028] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.581030] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.581031] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.581032] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.581033] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.581035] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.581036] CR2: 00007b785fbde000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [215.581038] PKRU: 55555554 <4> [215.581039] Call Trace: <4> [215.581040] <TASK> <4> [215.581044] ? lock_sync+0x100/0x100 <4> [215.581049] ? lock_release+0xd0/0x2b0 <4> [215.581054] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.581060] process_one_work+0x239/0x760 <4> [215.581066] worker_thread+0x200/0x3f0 <4> [215.581068] ? __pfx_worker_thread+0x10/0x10 <4> [215.581071] kthread+0x10d/0x150 <4> [215.581074] ? __pfx_kthread+0x10/0x10 <4> [215.581077] ret_from_fork+0x3d4/0x480 <4> [215.581079] ? __pfx_kthread+0x10/0x10 <4> [215.581082] ret_from_fork_asm+0x1a/0x30 <4> [215.581090] </TASK> <4> [215.581091] irq event stamp: 1655787 <4> [215.581092] hardirqs last enabled at (1655793): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.581095] hardirqs last disabled at (1655798): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.581097] softirqs last enabled at (1655020): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.581099] softirqs last disabled at (1655015): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.581102] ---[ end trace 0000000000000000 ]--- <5> [215.581674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65068, lrc_seqno=65068, guc_id=0, flags=0x73 in no process [-1] <7> [215.581677] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.581737] ------------[ cut here ]------------ <4> [215.581738] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.581740] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:143/6175 <4> [215.581820] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.581883] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.581887] CPU: 10 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.581890] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.581891] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.581892] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.581897] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.581966] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.581968] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.581970] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.581971] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.581972] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.581973] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.581974] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.581976] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.581977] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.581979] CR2: 00007b785fbde000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [215.581980] PKRU: 55555554 <4> [215.581981] Call Trace: <4> [215.581982] <TASK> <4> [215.581986] ? lock_sync+0x100/0x100 <4> [215.581990] ? lock_release+0xd0/0x2b0 <4> [215.581995] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.582000] process_one_work+0x239/0x760 <4> [215.582006] worker_thread+0x200/0x3f0 <4> [215.582009] ? __pfx_worker_thread+0x10/0x10 <4> [215.582011] kthread+0x10d/0x150 <4> [215.582014] ? __pfx_kthread+0x10/0x10 <4> [215.582017] ret_from_fork+0x3d4/0x480 <4> [215.582019] ? __pfx_kthread+0x10/0x10 <4> [215.582023] ret_from_fork_asm+0x1a/0x30 <4> [215.582030] </TASK> <4> [215.582031] irq event stamp: 1658403 <4> [215.582032] hardirqs last enabled at (1658409): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.582035] hardirqs last disabled at (1658414): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.582037] softirqs last enabled at (1655020): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.582039] softirqs last disabled at (1655015): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.582041] ---[ end trace 0000000000000000 ]--- <6> [215.582911] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.582984] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.582994] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.583008] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.583111] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.583217] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.583423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.583515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.583609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.583698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.583793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.583880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.583964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.584051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.584136] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.584232] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.584349] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.585358] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.595785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.596035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.597091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.597169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.597238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.597310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.597380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.597449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.597518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.597586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.597654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.597720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.597798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.597872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.597945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.598018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.598090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.598162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.598237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.598311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.598385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.598467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.598549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.598627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.598706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.598789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.598865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.598942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.599018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.599097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.599176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.599254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.599337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.599418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.599504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.599589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.599672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.599752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.599839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.599916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.599992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.600068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.600151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.600230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.600307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.600384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.600466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.600543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.600620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.600698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.600782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.600861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.600939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.601018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.601095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.601172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.601248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.601325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.601401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.601480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.601561] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.601674] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.601678] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65068, lrc_seqno=65068, guc_id=0, flags=0x73 in no process [-1] <7> [215.601681] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.601739] ------------[ cut here ]------------ <4> [215.601740] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.601742] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:142/6174 <4> [215.601825] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.601890] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.601895] CPU: 2 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.601898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.601899] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.601900] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.601905] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.601976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.601978] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.601980] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.601982] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.601983] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.601984] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.601985] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.601987] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.601988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.601990] CR2: 00007b785fbe0000 CR3: 000000013970b006 CR4: 0000000000f72ef0 <4> [215.601991] PKRU: 55555554 <4> [215.601992] Call Trace: <4> [215.601993] <TASK> <4> [215.601997] ? lock_sync+0x100/0x100 <4> [215.602002] ? lock_release+0xd0/0x2b0 <4> [215.602007] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.602013] process_one_work+0x239/0x760 <4> [215.602019] worker_thread+0x200/0x3f0 <4> [215.602022] ? __pfx_worker_thread+0x10/0x10 <4> [215.602024] kthread+0x10d/0x150 <4> [215.602027] ? __pfx_kthread+0x10/0x10 <4> [215.602031] ret_from_fork+0x3d4/0x480 <4> [215.602033] ? __pfx_kthread+0x10/0x10 <4> [215.602036] ret_from_fork_asm+0x1a/0x30 <4> [215.602043] </TASK> <4> [215.602044] irq event stamp: 731671 <4> [215.602045] hardirqs last enabled at (731677): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.602048] hardirqs last disabled at (731682): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.602050] softirqs last enabled at (730922): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.602053] softirqs last disabled at (730899): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.602055] ---[ end trace 0000000000000000 ]--- <6> [215.602982] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.603054] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.603064] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.603075] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.603176] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.603284] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.603545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.603682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.603849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.603937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.604023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.604111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.604198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.604286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.604367] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.604462] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.604579] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.605587] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.615785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.616034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.617099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.617176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.617254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.617330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.617407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.617483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.617559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.617635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.617709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.617790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.617868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.617943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.618016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.618090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.618164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.618237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.618310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.618383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.618457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.618541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.618623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.618702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.618788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.618865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.618941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.619017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.619093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.619175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.619257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.619337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.619416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.619494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.619578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.619661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.619745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.619834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.619912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.619992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.620071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.620149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.620229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.620306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.620383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.620457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.620538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.620618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.620696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.620774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.620865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.620940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.621015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.621093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.621170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.621246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.621321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.621398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.621474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.621551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.621631] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.621744] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.621748] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65068, lrc_seqno=65068, guc_id=0, flags=0x73 in no process [-1] <7> [215.621751] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.621823] ------------[ cut here ]------------ <4> [215.621824] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.621826] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [215.621897] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.621961] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.621966] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.621968] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.621970] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.621971] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.621976] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.622047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.622048] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.622051] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.622052] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.622054] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.622055] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.622056] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.622057] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.622059] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.622060] CR2: 00007b785fbe0000 CR3: 000000013970b006 CR4: 0000000000f72ef0 <4> [215.622062] PKRU: 55555554 <4> [215.622063] Call Trace: <4> [215.622064] <TASK> <4> [215.622068] ? lock_sync+0x100/0x100 <4> [215.622072] ? lock_release+0xd0/0x2b0 <4> [215.622077] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.622083] process_one_work+0x239/0x760 <4> [215.622089] worker_thread+0x200/0x3f0 <4> [215.622092] ? __pfx_worker_thread+0x10/0x10 <4> [215.622094] kthread+0x10d/0x150 <4> [215.622097] ? __pfx_kthread+0x10/0x10 <4> [215.622100] ret_from_fork+0x3d4/0x480 <4> [215.622102] ? __pfx_kthread+0x10/0x10 <4> [215.622105] ret_from_fork_asm+0x1a/0x30 <4> [215.622113] </TASK> <4> [215.622114] irq event stamp: 1010533 <4> [215.622115] hardirqs last enabled at (1010539): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.622118] hardirqs last disabled at (1010544): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.622120] softirqs last enabled at (1009766): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.622122] softirqs last disabled at (1009759): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.622124] ---[ end trace 0000000000000000 ]--- <5> [215.622704] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65123, lrc_seqno=65123, guc_id=0, flags=0x73 in no process [-1] <7> [215.622707] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.622766] ------------[ cut here ]------------ <4> [215.622767] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.622768] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [215.622851] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.622913] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.622917] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.622920] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.622921] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.622922] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.622927] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.622995] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.622996] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.622998] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.623000] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.623001] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.623002] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.623003] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.623005] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [215.623006] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.623007] CR2: 00007b785fbe0000 CR3: 000000013970b006 CR4: 0000000000f72ef0 <4> [215.623009] PKRU: 55555554 <4> [215.623010] Call Trace: <4> [215.623011] <TASK> <4> [215.623014] ? lock_sync+0x100/0x100 <4> [215.623018] ? lock_release+0xd0/0x2b0 <4> [215.623024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.623029] process_one_work+0x239/0x760 <4> [215.623035] worker_thread+0x200/0x3f0 <4> [215.623037] ? __pfx_worker_thread+0x10/0x10 <4> [215.623040] kthread+0x10d/0x150 <4> [215.623042] ? __pfx_kthread+0x10/0x10 <4> [215.623046] ret_from_fork+0x3d4/0x480 <4> [215.623048] ? __pfx_kthread+0x10/0x10 <4> [215.623051] ret_from_fork_asm+0x1a/0x30 <4> [215.623058] </TASK> <4> [215.623060] irq event stamp: 1013191 <4> [215.623061] hardirqs last enabled at (1013197): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.623063] hardirqs last disabled at (1013202): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.623065] softirqs last enabled at (1009766): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.623068] softirqs last disabled at (1009759): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.623070] ---[ end trace 0000000000000000 ]--- <6> [215.623887] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.623957] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.623965] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.623979] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.624080] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.624188] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.624396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.624489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.624583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.624670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.624755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.624849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.624934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.625020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.625102] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.625195] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.625310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.626317] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.636786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.637043] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.638134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.638214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.638284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.638354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.638422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.638491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.638559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.638626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.638694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.638760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.638841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.638913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.638989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.639066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.639144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.639217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.639290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.639362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.639435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.639516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.639598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.639678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.639760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.639847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.639925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.640000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.640076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.640156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.640235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.640312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.640391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.640469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.640552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.640639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.640725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.640811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.640892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.640970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.641048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.641124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.641202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.641279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.641356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.641436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.641517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.641597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.641675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.641751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.641837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.641913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.641987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.642066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.642141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.642217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.642292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.642370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.642449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.642526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.642606] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.642718] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.642723] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65123, lrc_seqno=65123, guc_id=0, flags=0x73 in no process [-1] <7> [215.642725] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.643635] ------------[ cut here ]------------ <4> [215.643637] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.643638] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:142/6174 <4> [215.643711] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.643781] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.643786] CPU: 8 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.643789] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.643790] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.643792] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.643797] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.643866] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.643867] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.643870] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.643871] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.643873] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.643874] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.643875] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.643876] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.643878] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.643879] CR2: 0000592d0aac742c CR3: 0000000136f7e005 CR4: 0000000000f72ef0 <4> [215.643881] PKRU: 55555554 <4> [215.643882] Call Trace: <4> [215.643883] <TASK> <4> [215.643887] ? lock_sync+0x100/0x100 <4> [215.643892] ? lock_release+0xd0/0x2b0 <4> [215.643897] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.643903] process_one_work+0x239/0x760 <4> [215.643910] worker_thread+0x200/0x3f0 <4> [215.643912] ? __pfx_worker_thread+0x10/0x10 <4> [215.643915] kthread+0x10d/0x150 <4> [215.643918] ? __pfx_kthread+0x10/0x10 <4> [215.643921] ret_from_fork+0x3d4/0x480 <4> [215.643924] ? __pfx_kthread+0x10/0x10 <4> [215.643927] ret_from_fork_asm+0x1a/0x30 <4> [215.643934] </TASK> <4> [215.643936] irq event stamp: 736771 <4> [215.643937] hardirqs last enabled at (736777): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.643940] hardirqs last disabled at (736782): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.643942] softirqs last enabled at (735998): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.643945] softirqs last disabled at (735991): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.643947] ---[ end trace 0000000000000000 ]--- <6> [215.643949] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.644018] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.644024] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.644037] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.644141] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.644435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.644644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.644736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.644840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.644930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.645017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.645102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.645188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.645278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.645362] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.645457] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.645573] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.646581] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.656785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.657032] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.658074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.658152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.658228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.658305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.658380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.658454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.658528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.658603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.658676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.658748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.658830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.658906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.658982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.659058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.659132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.659207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.659280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.659353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.659425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.659507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.659590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.659670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.659751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.659838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.659917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.659998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.660076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.660158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.660237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.660317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.660395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.660474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.660556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.660640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.660722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.660804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.660887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.660968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.661047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.661124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.661205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.661283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.661361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.661437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.661520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.661600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.661680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.661758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.661854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.661930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.662005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.662083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.662160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.662236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.662311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.662388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.662463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.662538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.662617] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.662728] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.662733] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65123, lrc_seqno=65123, guc_id=0, flags=0x73 in no process [-1] <7> [215.662735] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.663645] ------------[ cut here ]------------ <4> [215.663647] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.663649] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:143/6175 <4> [215.663725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.663794] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.663798] CPU: 10 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.663801] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.663803] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.663804] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.663809] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.663878] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.663880] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.663882] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.663884] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.663885] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.663886] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.663887] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.663889] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.663890] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.663892] CR2: 00007b785fbe1000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [215.663893] PKRU: 55555554 <4> [215.663895] Call Trace: <4> [215.663896] <TASK> <4> [215.663900] ? lock_sync+0x100/0x100 <4> [215.663904] ? lock_release+0xd0/0x2b0 <4> [215.663909] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.663915] process_one_work+0x239/0x760 <4> [215.663921] worker_thread+0x200/0x3f0 <4> [215.663924] ? __pfx_worker_thread+0x10/0x10 <4> [215.663926] kthread+0x10d/0x150 <4> [215.663929] ? __pfx_kthread+0x10/0x10 <4> [215.663933] ret_from_fork+0x3d4/0x480 <4> [215.663935] ? __pfx_kthread+0x10/0x10 <4> [215.663938] ret_from_fork_asm+0x1a/0x30 <4> [215.663945] </TASK> <4> [215.663946] irq event stamp: 1662529 <4> [215.663948] hardirqs last enabled at (1662535): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.663950] hardirqs last disabled at (1662540): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.663953] softirqs last enabled at (1661756): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.663955] softirqs last disabled at (1661749): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.663957] ---[ end trace 0000000000000000 ]--- <7> [215.664541] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.664646] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [215.664744] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65178, lrc_seqno=65178, guc_id=0, flags=0x73 in no process [-1] <7> [215.664746] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.664818] ------------[ cut here ]------------ <4> [215.664819] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.664821] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:143/6175 <4> [215.664912] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.664975] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.664979] CPU: 10 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.664982] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.664983] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.664984] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.664989] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.665060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.665062] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.665064] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.665066] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.665067] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.665068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.665070] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.665071] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.665073] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.665074] CR2: 00007b785fbe1000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [215.665076] PKRU: 55555554 <4> [215.665077] Call Trace: <4> [215.665079] <TASK> <4> [215.665083] ? lock_sync+0x100/0x100 <4> [215.665087] ? lock_release+0xd0/0x2b0 <4> [215.665092] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.665098] process_one_work+0x239/0x760 <4> [215.665104] worker_thread+0x200/0x3f0 <4> [215.665107] ? __pfx_worker_thread+0x10/0x10 <4> [215.665110] kthread+0x10d/0x150 <4> [215.665113] ? __pfx_kthread+0x10/0x10 <4> [215.665116] ret_from_fork+0x3d4/0x480 <4> [215.665118] ? __pfx_kthread+0x10/0x10 <4> [215.665122] ret_from_fork_asm+0x1a/0x30 <4> [215.665129] </TASK> <4> [215.665131] irq event stamp: 1665141 <4> [215.665132] hardirqs last enabled at (1665147): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.665135] hardirqs last disabled at (1665152): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.665137] softirqs last enabled at (1661756): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.665140] softirqs last disabled at (1661749): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.665142] ---[ end trace 0000000000000000 ]--- <6> [215.665144] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.665215] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.665222] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.665270] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.665475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.665565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.665657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.665746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.665842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.665931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.666015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.666101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.666182] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.666275] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.666390] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.667400] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.677786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.678037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.679101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.679180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.679253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.679323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.679393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.679462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.679530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.679598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.679669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.679738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.679813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.679888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.679961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.680034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.680107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.680184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.680259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.680334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.680408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.680490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.680571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.680650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.680730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.680814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.680891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.680968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.681045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.681125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.681204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.681282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.681360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.681439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.681526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.681615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.681701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.681788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.681868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.681946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.682023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.682099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.682179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.682256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.682332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.682408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.682487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.682563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.682639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.682714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.682794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.682871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.682949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.683030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.683107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.683184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.683259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.683334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.683408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.683483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.683560] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.683671] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.683675] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65178, lrc_seqno=65178, guc_id=0, flags=0x73 in no process [-1] <7> [215.683678] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.683737] ------------[ cut here ]------------ <4> [215.683738] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.683739] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.683818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.683882] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.683887] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.683890] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.683891] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.683892] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.683897] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.683967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.683969] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.683971] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.683972] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.683974] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.683975] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.683976] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.683978] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.683979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.683981] CR2: 0000592d0aac742c CR3: 000000013970b006 CR4: 0000000000f72ef0 <4> [215.683982] PKRU: 55555554 <4> [215.683983] Call Trace: <4> [215.683984] <TASK> <4> [215.683988] ? lock_sync+0x100/0x100 <4> [215.683992] ? lock_release+0xd0/0x2b0 <4> [215.683998] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.684003] process_one_work+0x239/0x760 <4> [215.684009] worker_thread+0x200/0x3f0 <4> [215.684012] ? __pfx_worker_thread+0x10/0x10 <4> [215.684014] kthread+0x10d/0x150 <4> [215.684017] ? __pfx_kthread+0x10/0x10 <4> [215.684021] ret_from_fork+0x3d4/0x480 <4> [215.684023] ? __pfx_kthread+0x10/0x10 <4> [215.684026] ret_from_fork_asm+0x1a/0x30 <4> [215.684033] </TASK> <4> [215.684035] irq event stamp: 1018749 <4> [215.684036] hardirqs last enabled at (1018755): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.684039] hardirqs last disabled at (1018760): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.684041] softirqs last enabled at (1017740): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.684043] softirqs last disabled at (1017733): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.684046] ---[ end trace 0000000000000000 ]--- <6> [215.684047] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.684117] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.684123] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.684530] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.684731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.684837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.684929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.685016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.685103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.685186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.685268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.685354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.685437] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.685532] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.685647] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.686652] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.697373] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.697615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.698662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.698734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.698813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.698888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.698963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.699038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.699112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.699186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.699259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.699332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.699404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.699476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.699548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.699621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.699694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.699767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.699852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.699929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.700006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.700089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.700170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.700249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.700329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.700407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.700483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.700559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.700635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.700713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.700797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.700880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.700961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.701043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.701130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.701216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.701301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.701382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.701462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.701538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.701615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.701691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.701776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.701871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.701950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.702027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.702110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.702192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.702273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.702350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.702428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.702505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.702580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.702659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.702735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.702820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.702896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.702973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.703049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.703125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.703204] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.703315] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.703319] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65178, lrc_seqno=65178, guc_id=0, flags=0x73 in no process [-1] <7> [215.703322] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.703380] ------------[ cut here ]------------ <4> [215.703381] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.703382] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.703453] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.703516] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.703521] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.703523] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.703524] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.703526] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.703531] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.703601] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.703603] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.703605] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.703606] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.703607] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.703608] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.703610] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.703611] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.703612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.703614] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.703615] PKRU: 55555554 <4> [215.703616] Call Trace: <4> [215.703617] <TASK> <4> [215.703621] ? lock_sync+0x100/0x100 <4> [215.703625] ? lock_release+0xd0/0x2b0 <4> [215.703631] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.703636] process_one_work+0x239/0x760 <4> [215.703642] worker_thread+0x200/0x3f0 <4> [215.703645] ? __pfx_worker_thread+0x10/0x10 <4> [215.703647] kthread+0x10d/0x150 <4> [215.703650] ? __pfx_kthread+0x10/0x10 <4> [215.703654] ret_from_fork+0x3d4/0x480 <4> [215.703656] ? __pfx_kthread+0x10/0x10 <4> [215.703659] ret_from_fork_asm+0x1a/0x30 <4> [215.703666] </TASK> <4> [215.703667] irq event stamp: 1021919 <4> [215.703668] hardirqs last enabled at (1021925): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.703671] hardirqs last disabled at (1021930): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.703673] softirqs last enabled at (1021040): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.703676] softirqs last disabled at (1021033): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.703678] ---[ end trace 0000000000000000 ]--- <7> [215.704931] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.705038] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [215.705530] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65233, lrc_seqno=65233, guc_id=0, flags=0x73 in no process [-1] <7> [215.705534] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.705598] ------------[ cut here ]------------ <4> [215.705600] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.705601] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:142/6174 <4> [215.705675] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.705739] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.705744] CPU: 11 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.705747] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.705748] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.705749] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.705755] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.705876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.705880] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.705884] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.705887] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.705890] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.705893] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.705895] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.705898] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.705901] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.705904] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.705907] PKRU: 55555554 <4> [215.705909] Call Trace: <4> [215.705911] <TASK> <4> [215.705915] ? lock_sync+0x100/0x100 <4> [215.705919] ? lock_release+0xd0/0x2b0 <4> [215.705925] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.705930] process_one_work+0x239/0x760 <4> [215.705937] worker_thread+0x200/0x3f0 <4> [215.705940] ? __pfx_worker_thread+0x10/0x10 <4> [215.705942] kthread+0x10d/0x150 <4> [215.705945] ? __pfx_kthread+0x10/0x10 <4> [215.705949] ret_from_fork+0x3d4/0x480 <4> [215.705951] ? __pfx_kthread+0x10/0x10 <4> [215.705954] ret_from_fork_asm+0x1a/0x30 <4> [215.705962] </TASK> <4> [215.705963] irq event stamp: 741217 <4> [215.705964] hardirqs last enabled at (741223): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.705967] hardirqs last disabled at (741228): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.705970] softirqs last enabled at (741056): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.705972] softirqs last disabled at (741029): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.705975] ---[ end trace 0000000000000000 ]--- <6> [215.705977] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.706047] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.706053] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.706102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.706307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.706397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.706490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.706577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.706662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.706745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.706841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.706926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.707007] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.707103] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.707219] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.708226] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.718785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.719035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.720108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.720180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.720249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.720320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.720389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.720460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.720529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.720599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.720668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.720736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.720811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.720885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.720959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.721032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.721106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.721179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.721252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.721324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.721396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.721476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.721554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.721632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.721713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.721797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.721874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.721950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.722026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.722104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.722184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.722260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.722338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.722416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.722498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.722580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.722664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.722746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.722836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.722916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.722994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.723070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.723149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.723227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.723304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.723379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.723462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.723541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.723619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.723695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.723773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.723862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.723939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.724018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.724095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.724171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.724246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.724321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.724398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.724477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.724557] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.724668] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.724672] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65233, lrc_seqno=65233, guc_id=0, flags=0x73 in no process [-1] <7> [215.724674] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.724732] ------------[ cut here ]------------ <4> [215.724733] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.724735] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:286/6318 <4> [215.724813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.724890] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.724895] CPU: 8 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.724898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.724899] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.724901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.724906] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.724976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.724978] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.724980] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.724982] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.724984] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.724985] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.724986] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.724988] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.724990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.724991] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.724993] PKRU: 55555554 <4> [215.724995] Call Trace: <4> [215.724996] <TASK> <4> [215.725000] ? lock_sync+0x100/0x100 <4> [215.725004] ? lock_release+0xd0/0x2b0 <4> [215.725010] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.725016] process_one_work+0x239/0x760 <4> [215.725022] worker_thread+0x200/0x3f0 <4> [215.725025] ? __pfx_worker_thread+0x10/0x10 <4> [215.725027] kthread+0x10d/0x150 <4> [215.725030] ? __pfx_kthread+0x10/0x10 <4> [215.725034] ret_from_fork+0x3d4/0x480 <4> [215.725036] ? __pfx_kthread+0x10/0x10 <4> [215.725040] ret_from_fork_asm+0x1a/0x30 <4> [215.725047] </TASK> <4> [215.725048] irq event stamp: 1027329 <4> [215.725050] hardirqs last enabled at (1027335): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.725053] hardirqs last disabled at (1027340): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.725055] softirqs last enabled at (1026420): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.725058] softirqs last disabled at (1026413): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.725060] ---[ end trace 0000000000000000 ]--- <6> [215.725858] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.726041] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.726049] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.726098] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.726202] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.726308] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.726515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.726604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.726698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.726800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.726889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.726974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.727061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.727146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.727227] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.727322] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.727438] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.728532] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.739136] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.739377] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.740539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.740614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.740686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.740757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.740843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.740918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.740993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.741068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.741142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.741216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.741290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.741365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.741442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.741518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.741593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.741666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.741740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.741823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.741897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.741979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.742061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.742140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.742220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.742296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.742373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.742450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.742526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.742605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.742686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.742768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.742865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.742947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.743032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.743116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.743199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.743280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.743360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.743438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.743515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.743591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.743670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.743746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.743835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.743911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.743994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.744074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.744151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.744228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.744306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.744381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.744456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.744536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.744617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.744697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.744775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.744870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.744945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.745020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.745098] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.745210] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.745215] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65233, lrc_seqno=65233, guc_id=0, flags=0x73 in no process [-1] <7> [215.745217] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.745277] ------------[ cut here ]------------ <4> [215.745278] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.745280] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:286/6318 <4> [215.745352] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.745417] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.745421] CPU: 9 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.745424] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.745426] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.745427] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.745432] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.745503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.745504] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.745507] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.745508] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.745509] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.745511] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.745512] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.745513] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.745515] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.745516] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.745517] PKRU: 55555554 <4> [215.745519] Call Trace: <4> [215.745520] <TASK> <4> [215.745524] ? lock_sync+0x100/0x100 <4> [215.745528] ? lock_release+0xd0/0x2b0 <4> [215.745534] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.745539] process_one_work+0x239/0x760 <4> [215.745546] worker_thread+0x200/0x3f0 <4> [215.745548] ? __pfx_worker_thread+0x10/0x10 <4> [215.745551] kthread+0x10d/0x150 <4> [215.745554] ? __pfx_kthread+0x10/0x10 <4> [215.745557] ret_from_fork+0x3d4/0x480 <4> [215.745559] ? __pfx_kthread+0x10/0x10 <4> [215.745563] ret_from_fork_asm+0x1a/0x30 <4> [215.745570] </TASK> <4> [215.745571] irq event stamp: 1030451 <4> [215.745572] hardirqs last enabled at (1030457): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.745575] hardirqs last disabled at (1030462): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.745577] softirqs last enabled at (1029496): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.745579] softirqs last disabled at (1029489): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.745582] ---[ end trace 0000000000000000 ]--- <5> [215.746584] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65288, lrc_seqno=65288, guc_id=0, flags=0x73 in no process [-1] <7> [215.746588] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.746647] ------------[ cut here ]------------ <4> [215.746648] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.746650] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:286/6318 <4> [215.746721] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.746791] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.746795] CPU: 9 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.746798] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.746799] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.746800] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.746805] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.746874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.746876] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.746878] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.746879] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.746880] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.746881] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.746882] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.746884] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.746885] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.746886] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.746888] PKRU: 55555554 <4> [215.746889] Call Trace: <4> [215.746890] <TASK> <4> [215.746894] ? lock_sync+0x100/0x100 <4> [215.746898] ? lock_release+0xd0/0x2b0 <4> [215.746903] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.746909] process_one_work+0x239/0x760 <4> [215.746914] worker_thread+0x200/0x3f0 <4> [215.746917] ? __pfx_worker_thread+0x10/0x10 <4> [215.746919] kthread+0x10d/0x150 <4> [215.746922] ? __pfx_kthread+0x10/0x10 <4> [215.746926] ret_from_fork+0x3d4/0x480 <4> [215.746928] ? __pfx_kthread+0x10/0x10 <4> [215.746931] ret_from_fork_asm+0x1a/0x30 <4> [215.746938] </TASK> <4> [215.746939] irq event stamp: 1031727 <4> [215.746941] hardirqs last enabled at (1031733): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.746943] hardirqs last disabled at (1031738): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.746946] softirqs last enabled at (1029496): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.746948] softirqs last disabled at (1029489): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.746950] ---[ end trace 0000000000000000 ]--- <7> [215.746963] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.747065] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [215.747160] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.747229] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.747235] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.747283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.747488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.747579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.747673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.747760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.747860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.747944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.748027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.748113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.748197] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.748296] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.748414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.749427] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.759787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.760038] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.761132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.761213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.761290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.761368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.761444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.761519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.761594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.761669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.761744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.761830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.761905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.761978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.762051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.762125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.762197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.762270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.762344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.762420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.762496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.762578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.762660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.762738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.762829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.762907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.762983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.763058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.763136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.763216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.763296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.763377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.763459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.763540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.763624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.763708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.763799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.763879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.763958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.764034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.764110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.764184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.764263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.764340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.764417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.764495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.764580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.764659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.764736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.764828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.764906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.764982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.765058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.765136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.765213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.765289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.765365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.765443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.765522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.765601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.765681] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.765802] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.765806] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65288, lrc_seqno=65288, guc_id=0, flags=0x73 in no process [-1] <7> [215.765809] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.765867] ------------[ cut here ]------------ <4> [215.765868] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.765870] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:142/6174 <4> [215.765942] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.766006] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.766010] CPU: 11 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.766013] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.766015] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.766016] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.766021] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.766092] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.766094] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.766096] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.766097] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.766099] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.766100] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.766101] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.766102] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.766104] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.766105] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.766107] PKRU: 55555554 <4> [215.766108] Call Trace: <4> [215.766109] <TASK> <4> [215.766113] ? lock_sync+0x100/0x100 <4> [215.766118] ? lock_release+0xd0/0x2b0 <4> [215.766123] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.766128] process_one_work+0x239/0x760 <4> [215.766134] worker_thread+0x200/0x3f0 <4> [215.766137] ? __pfx_worker_thread+0x10/0x10 <4> [215.766139] kthread+0x10d/0x150 <4> [215.766142] ? __pfx_kthread+0x10/0x10 <4> [215.766146] ret_from_fork+0x3d4/0x480 <4> [215.766148] ? __pfx_kthread+0x10/0x10 <4> [215.766151] ret_from_fork_asm+0x1a/0x30 <4> [215.766158] </TASK> <4> [215.766159] irq event stamp: 746771 <4> [215.766161] hardirqs last enabled at (746777): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.766164] hardirqs last disabled at (746782): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.766166] softirqs last enabled at (745964): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.766168] softirqs last disabled at (745957): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.766170] ---[ end trace 0000000000000000 ]--- <6> [215.766172] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.766242] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.766250] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.767506] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.767610] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.767717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.767930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.768022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.768118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.768206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.768295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.768380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.768464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.768552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.768638] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.768733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.768862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.769886] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.780608] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.780861] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.781936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.782009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.782078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.782147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.782217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.782285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.782353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.782423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.782493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.782562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.782631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.782698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.782766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.782852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.782929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.783005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.783080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.783154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.783227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.783308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.783387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.783465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.783545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.783627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.783707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.783790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.783870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.783943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.784016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.784088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.784160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.784231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.784308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.784383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.784460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.784533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.784605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.784674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.784744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.784826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.784904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.784978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.785051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.785122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.785196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.785266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.785335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.785404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.785473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.785541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.785609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.785679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.785748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.785828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.785901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.785974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.786047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.786118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.786190] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.786300] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.786304] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65288, lrc_seqno=65288, guc_id=0, flags=0x73 in no process [-1] <7> [215.786306] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.786360] ------------[ cut here ]------------ <4> [215.786361] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.786362] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:143/6175 <4> [215.786426] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.786485] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.786490] CPU: 10 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.786492] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.786493] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.786495] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.786500] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.786562] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.786564] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.786566] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.786567] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.786569] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.786570] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.786571] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.786572] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [215.786573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.786575] CR2: 00007b785fbe2000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.786576] PKRU: 55555554 <4> [215.786577] Call Trace: <4> [215.786578] <TASK> <4> [215.786582] ? lock_sync+0x100/0x100 <4> [215.786586] ? lock_release+0xd0/0x2b0 <4> [215.786591] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.786596] process_one_work+0x239/0x760 <4> [215.786601] worker_thread+0x200/0x3f0 <4> [215.786604] ? __pfx_worker_thread+0x10/0x10 <4> [215.786606] kthread+0x10d/0x150 <4> [215.786609] ? __pfx_kthread+0x10/0x10 <4> [215.786612] ret_from_fork+0x3d4/0x480 <4> [215.786614] ? __pfx_kthread+0x10/0x10 <4> [215.786617] ret_from_fork_asm+0x1a/0x30 <4> [215.786624] </TASK> <4> [215.786625] irq event stamp: 1669059 <4> [215.786626] hardirqs last enabled at (1669065): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.786628] hardirqs last disabled at (1669070): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.786630] softirqs last enabled at (1668180): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.786633] softirqs last disabled at (1668173): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.786635] ---[ end trace 0000000000000000 ]--- <7> [215.788120] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.788238] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [215.788651] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65343, lrc_seqno=65343, guc_id=0, flags=0x73 in no process [-1] <7> [215.788654] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.788713] ------------[ cut here ]------------ <4> [215.788714] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.788716] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:143/6175 <4> [215.788792] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.788855] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.788860] CPU: 11 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.788863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.788864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.788865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.788870] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.788940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.788942] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.788944] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.788945] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.788946] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.788947] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.788949] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.788950] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.788952] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.788953] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.788954] PKRU: 55555554 <4> [215.788956] Call Trace: <4> [215.788957] <TASK> <4> [215.788960] ? lock_sync+0x100/0x100 <4> [215.788965] ? lock_release+0xd0/0x2b0 <4> [215.788970] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.788976] process_one_work+0x239/0x760 <4> [215.788982] worker_thread+0x200/0x3f0 <4> [215.788984] ? __pfx_worker_thread+0x10/0x10 <4> [215.788987] kthread+0x10d/0x150 <4> [215.788990] ? __pfx_kthread+0x10/0x10 <4> [215.788993] ret_from_fork+0x3d4/0x480 <4> [215.788995] ? __pfx_kthread+0x10/0x10 <4> [215.788998] ret_from_fork_asm+0x1a/0x30 <4> [215.789006] </TASK> <4> [215.789007] irq event stamp: 1671635 <4> [215.789008] hardirqs last enabled at (1671641): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.789010] hardirqs last disabled at (1671646): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.789013] softirqs last enabled at (1668180): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.789015] softirqs last disabled at (1668173): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.789017] ---[ end trace 0000000000000000 ]--- <6> [215.789019] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.789088] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.789094] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.789179] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.789381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.789469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.789559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.789645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.789730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.789828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.789916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.790003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.790085] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.790180] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.790296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.791298] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.801786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.802038] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.803111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.803184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.803253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.803323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.803393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.803461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.803530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.803598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.803666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.803735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.803812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.803888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.803958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.804028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.804097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.804164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.804231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.804299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.804366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.804440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.804519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.804597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.804676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.804754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.804855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.804937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.805016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.805096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.805177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.805254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.805331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.805413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.805500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.805586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.805671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.805752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.805844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.805920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.805996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.806072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.806150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.806227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.806304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.806379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.806461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.806541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.806620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.806696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.806773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.806864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.806939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.807019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.807094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.807169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.807244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.807321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.807397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.807475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.807555] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.807666] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.807670] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65343, lrc_seqno=65343, guc_id=0, flags=0x73 in no process [-1] <7> [215.807673] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.807730] ------------[ cut here ]------------ <4> [215.807731] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.807733] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:143/6175 <4> [215.807818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.807882] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.807887] CPU: 11 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.807890] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.807891] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.807893] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.807898] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.807968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.807969] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.807971] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.807973] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.807974] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.807975] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.807976] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.807978] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.807979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.807981] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.807982] PKRU: 55555554 <4> [215.807983] Call Trace: <4> [215.807984] <TASK> <4> [215.807988] ? lock_sync+0x100/0x100 <4> [215.807993] ? lock_release+0xd0/0x2b0 <4> [215.807998] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.808004] process_one_work+0x239/0x760 <4> [215.808010] worker_thread+0x200/0x3f0 <4> [215.808012] ? __pfx_worker_thread+0x10/0x10 <4> [215.808015] kthread+0x10d/0x150 <4> [215.808018] ? __pfx_kthread+0x10/0x10 <4> [215.808021] ret_from_fork+0x3d4/0x480 <4> [215.808023] ? __pfx_kthread+0x10/0x10 <4> [215.808027] ret_from_fork_asm+0x1a/0x30 <4> [215.808034] </TASK> <4> [215.808035] irq event stamp: 1674829 <4> [215.808036] hardirqs last enabled at (1674835): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.808039] hardirqs last disabled at (1674840): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.808041] softirqs last enabled at (1674080): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.808044] softirqs last disabled at (1674059): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.808046] ---[ end trace 0000000000000000 ]--- <6> [215.808048] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.808118] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.808124] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.809367] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.809471] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.809576] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.809791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.809883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.809976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.810064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.810151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.810235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.810319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.810407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.810486] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.810580] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.810698] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.811701] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.822423] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.822665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.823698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.823770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.823860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.823936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.824012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.824089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.824165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.824240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.824314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.824389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.824467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.824546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.824621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.824696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.824770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.824860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.824935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.825008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.825081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.825162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.825244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.825323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.825402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.825479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.825556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.825631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.825706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.825789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.825868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.825946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.826025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.826103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.826185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.826270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.826358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.826441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.826522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.826600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.826677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.826756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.826850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.826931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.827010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.827086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.827166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.827243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.827320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.827398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.827477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.827552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.827628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.827706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.827785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.827861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.827935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.828012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.828086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.828161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.828238] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.828353] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.828357] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65343, lrc_seqno=65343, guc_id=0, flags=0x73 in no process [-1] <7> [215.828360] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.828418] ------------[ cut here ]------------ <4> [215.828419] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.828421] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:286/6318 <4> [215.828493] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.828557] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.828561] CPU: 9 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.828564] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.828565] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.828567] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.828572] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.828640] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.828642] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.828645] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.828646] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.828647] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.828649] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.828650] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.828651] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.828653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.828654] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.828656] PKRU: 55555554 <4> [215.828657] Call Trace: <4> [215.828658] <TASK> <4> [215.828662] ? lock_sync+0x100/0x100 <4> [215.828667] ? lock_release+0xd0/0x2b0 <4> [215.828672] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.828678] process_one_work+0x239/0x760 <4> [215.828684] worker_thread+0x200/0x3f0 <4> [215.828687] ? __pfx_worker_thread+0x10/0x10 <4> [215.828689] kthread+0x10d/0x150 <4> [215.828692] ? __pfx_kthread+0x10/0x10 <4> [215.828696] ret_from_fork+0x3d4/0x480 <4> [215.828698] ? __pfx_kthread+0x10/0x10 <4> [215.828701] ret_from_fork_asm+0x1a/0x30 <4> [215.828708] </TASK> <4> [215.828709] irq event stamp: 1035213 <4> [215.828711] hardirqs last enabled at (1035219): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.828714] hardirqs last disabled at (1035224): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.828716] softirqs last enabled at (1034136): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.828718] softirqs last disabled at (1034127): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.828721] ---[ end trace 0000000000000000 ]--- <7> [215.829799] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.829906] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [215.830119] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65398, lrc_seqno=65398, guc_id=0, flags=0x73 in no process [-1] <7> [215.830122] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.830180] ------------[ cut here ]------------ <4> [215.830181] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.830182] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:286/6318 <4> [215.830253] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.830315] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.830319] CPU: 9 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.830322] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.830323] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.830324] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.830329] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.830397] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.830399] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.830401] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.830402] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.830403] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.830405] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.830406] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.830407] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.830409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.830410] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.830411] PKRU: 55555554 <4> [215.830413] Call Trace: <4> [215.830414] <TASK> <4> [215.830417] ? lock_sync+0x100/0x100 <4> [215.830422] ? lock_release+0xd0/0x2b0 <4> [215.830427] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.830433] process_one_work+0x239/0x760 <4> [215.830439] worker_thread+0x200/0x3f0 <4> [215.830441] ? __pfx_worker_thread+0x10/0x10 <4> [215.830444] kthread+0x10d/0x150 <4> [215.830447] ? __pfx_kthread+0x10/0x10 <4> [215.830450] ret_from_fork+0x3d4/0x480 <4> [215.830452] ? __pfx_kthread+0x10/0x10 <4> [215.830455] ret_from_fork_asm+0x1a/0x30 <4> [215.830463] </TASK> <4> [215.830464] irq event stamp: 1036809 <4> [215.830465] hardirqs last enabled at (1036815): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.830467] hardirqs last disabled at (1036820): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.830470] softirqs last enabled at (1035610): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.830472] softirqs last disabled at (1035605): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.830474] ---[ end trace 0000000000000000 ]--- <6> [215.830476] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.830544] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.830550] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.830601] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.830811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.830901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.830995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.831082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.831169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.831255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.831342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.831433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.831518] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.831613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.831729] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.832775] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.842841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.843091] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.844157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.844236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.844312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.844387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.844463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.844537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.844612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.844686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.844760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.844844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.844921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.844996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.845071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.845144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.845218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.845292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.845364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.845437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.845510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.845592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.845672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.845750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.845840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.845918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.845998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.846076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.846154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.846233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.846311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.846389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.846466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.846544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.846627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.846710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.846796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.846876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.846954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.847030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.847105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.847180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.847258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.847335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.847416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.847494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.847576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.847654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.847731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.847814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.847892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.847971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.848048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.848127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.848203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.848282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.848361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.848441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.848517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.848592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.848669] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.848783] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.848787] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65398, lrc_seqno=65398, guc_id=0, flags=0x73 in no process [-1] <7> [215.848789] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.848847] ------------[ cut here ]------------ <4> [215.848849] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.848850] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:143/6175 <4> [215.848921] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.848984] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.848989] CPU: 11 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.848992] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.848993] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.848994] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.848999] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.849070] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.849072] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.849074] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.849075] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.849076] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.849078] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.849079] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.849080] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.849082] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.849083] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.849085] PKRU: 55555554 <4> [215.849086] Call Trace: <4> [215.849087] <TASK> <4> [215.849091] ? lock_sync+0x100/0x100 <4> [215.849095] ? lock_release+0xd0/0x2b0 <4> [215.849101] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.849106] process_one_work+0x239/0x760 <4> [215.849112] worker_thread+0x200/0x3f0 <4> [215.849115] ? __pfx_worker_thread+0x10/0x10 <4> [215.849117] kthread+0x10d/0x150 <4> [215.849120] ? __pfx_kthread+0x10/0x10 <4> [215.849124] ret_from_fork+0x3d4/0x480 <4> [215.849126] ? __pfx_kthread+0x10/0x10 <4> [215.849129] ret_from_fork_asm+0x1a/0x30 <4> [215.849136] </TASK> <4> [215.849137] irq event stamp: 1680521 <4> [215.849138] hardirqs last enabled at (1680527): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.849141] hardirqs last disabled at (1680532): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.849143] softirqs last enabled at (1679502): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.849146] softirqs last disabled at (1679495): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.849148] ---[ end trace 0000000000000000 ]--- <6> [215.849150] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.849220] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.849226] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.850456] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.850561] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.850666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.850875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.850965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.851057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.851146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.851232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.851316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.851401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.851488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.851568] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.851662] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.851777] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.852801] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.863523] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.863765] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.864855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.864926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.864995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.865064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.865133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.865202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.865273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.865343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.865412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.865479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.865545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.865613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.865680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.865746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.865827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.865905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.865981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.866057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.866132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.866213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.866294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.866373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.866453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.866533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.866612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.866689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.866766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.866860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.866945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.867027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.867111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.867191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.867277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.867362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.867445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.867526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.867605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.867681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.867758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.867846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.867930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.868011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.868089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.868168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.868249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.868327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.868406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.868483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.868560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.868634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.868708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.868791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.868868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.868946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.869025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.869106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.869182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.869258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.869337] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.869452] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.869456] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65398, lrc_seqno=65398, guc_id=0, flags=0x73 in no process [-1] <7> [215.869458] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.869516] ------------[ cut here ]------------ <4> [215.869517] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.869519] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:142/6174 <4> [215.869589] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.869653] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.869658] CPU: 8 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.869661] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.869662] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.869663] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.869668] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.869737] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.869739] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.869741] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.869743] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.869744] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.869746] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.869747] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.869748] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.869750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.869751] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.869752] PKRU: 55555554 <4> [215.869754] Call Trace: <4> [215.869755] <TASK> <4> [215.869759] ? lock_sync+0x100/0x100 <4> [215.869763] ? lock_release+0xd0/0x2b0 <4> [215.869769] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.869774] process_one_work+0x239/0x760 <4> [215.869787] worker_thread+0x200/0x3f0 <4> [215.869790] ? __pfx_worker_thread+0x10/0x10 <4> [215.869792] kthread+0x10d/0x150 <4> [215.869795] ? __pfx_kthread+0x10/0x10 <4> [215.869799] ret_from_fork+0x3d4/0x480 <4> [215.869801] ? __pfx_kthread+0x10/0x10 <4> [215.869805] ret_from_fork_asm+0x1a/0x30 <4> [215.869812] </TASK> <4> [215.869814] irq event stamp: 752767 <4> [215.869815] hardirqs last enabled at (752773): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.869818] hardirqs last disabled at (752778): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.869820] softirqs last enabled at (752718): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.869823] softirqs last disabled at (752713): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.869825] ---[ end trace 0000000000000000 ]--- <5> [215.870822] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65453, lrc_seqno=65453, guc_id=0, flags=0x73 in no process [-1] <7> [215.870831] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.871220] ------------[ cut here ]------------ <4> [215.871224] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.871227] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [215.871560] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.871629] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.871634] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.871636] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.871637] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.871639] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.871644] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [215.871664] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [215.871754] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.871757] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.871760] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.871761] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.871763] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.871764] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.871766] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.871767] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.871769] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.871771] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.871773] PKRU: 55555554 <4> [215.871774] Call Trace: <4> [215.871775] <TASK> <4> [215.871788] ? lock_sync+0x100/0x100 <4> [215.871796] ? lock_release+0xd0/0x2b0 <4> [215.871804] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.871820] process_one_work+0x239/0x760 <4> [215.871831] worker_thread+0x200/0x3f0 <4> [215.871836] ? __pfx_worker_thread+0x10/0x10 <4> [215.871840] kthread+0x10d/0x150 <4> [215.871843] ? __pfx_kthread+0x10/0x10 <4> [215.871848] ret_from_fork+0x3d4/0x480 <4> [215.871851] ? __pfx_kthread+0x10/0x10 <4> [215.871855] ret_from_fork_asm+0x1a/0x30 <4> [215.871868] </TASK> <4> [215.871870] irq event stamp: 755569 <4> [215.871872] hardirqs last enabled at (755575): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.871876] hardirqs last disabled at (755580): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.871880] softirqs last enabled at (752718): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.871884] softirqs last disabled at (752713): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.871887] ---[ end trace 0000000000000000 ]--- <7> [215.871824] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [215.871890] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.871992] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.871998] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.872230] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.872434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.872522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.872612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.872699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.872792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.872878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.872963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.873050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.873131] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.873224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.873342] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.874356] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.884786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.885034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.886120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.886200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.886276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.886355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.886432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.886507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.886582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.886655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.886729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.886811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.886895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.886969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.887041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.887114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.887186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.887259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.887331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.887404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.887477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.887558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.887638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.887720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.887810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.887888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.887967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.888043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.888118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.888196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.888275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.888352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.888431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.888509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.888592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.888674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.888758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.888849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.888931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.889011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.889089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.889165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.889245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.889322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.889399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.889476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.889556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.889631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.889707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.889788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.889866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.889942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.890017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.890096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.890175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.890252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.890329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.890408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.890486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.890561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.890640] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.890752] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.890757] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65453, lrc_seqno=65453, guc_id=0, flags=0x73 in no process [-1] <7> [215.890759] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.890837] ------------[ cut here ]------------ <4> [215.890838] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.890839] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [215.890910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.890973] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.890978] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.890981] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.890982] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.890983] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.890988] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.891058] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.891060] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.891062] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.891063] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.891064] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.891066] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.891067] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.891068] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.891070] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.891071] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.891072] PKRU: 55555554 <4> [215.891074] Call Trace: <4> [215.891075] <TASK> <4> [215.891079] ? lock_sync+0x100/0x100 <4> [215.891083] ? lock_release+0xd0/0x2b0 <4> [215.891088] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.891094] process_one_work+0x239/0x760 <4> [215.891100] worker_thread+0x200/0x3f0 <4> [215.891103] ? __pfx_worker_thread+0x10/0x10 <4> [215.891105] kthread+0x10d/0x150 <4> [215.891108] ? __pfx_kthread+0x10/0x10 <4> [215.891112] ret_from_fork+0x3d4/0x480 <4> [215.891114] ? __pfx_kthread+0x10/0x10 <4> [215.891117] ret_from_fork_asm+0x1a/0x30 <4> [215.891124] </TASK> <4> [215.891125] irq event stamp: 758703 <4> [215.891127] hardirqs last enabled at (758709): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.891130] hardirqs last disabled at (758714): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.891132] softirqs last enabled at (757936): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.891134] softirqs last disabled at (757929): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.891136] ---[ end trace 0000000000000000 ]--- <6> [215.891138] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.891208] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.891214] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.892459] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.892561] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.892664] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.892877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.892968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.893062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.893153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.893241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.893326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.893411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.893497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.893579] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.893674] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.893791] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.894831] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.904787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.905034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.906112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.906191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.906266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.906343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.906419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.906493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.906568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.906643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.906717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.906800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.906878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.906954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.907030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.907105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.907177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.907250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.907323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.907396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.907470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.907550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.907632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.907712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.907803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.907881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.907956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.908031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.908107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.908183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.908261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.908338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.908419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.908502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.908588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.908674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.908761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.908859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.908940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.909017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.909094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.909169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.909249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.909329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.909402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.909474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.909549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.909620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.909693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.909766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.909855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.909928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.909997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.910070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.910140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.910210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.910279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.910349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.910418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.910490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.910566] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.910671] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.910675] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65453, lrc_seqno=65453, guc_id=0, flags=0x73 in no process [-1] <7> [215.910677] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.910743] ------------[ cut here ]------------ <4> [215.910745] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.910746] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [215.910826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.910896] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.910901] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.910904] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.910905] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.910907] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.910912] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.910982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.910984] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.910986] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.910988] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.910989] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.910990] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.910992] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.910993] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.910995] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.910996] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.910998] PKRU: 55555554 <4> [215.910999] Call Trace: <4> [215.911000] <TASK> <4> [215.911004] ? lock_sync+0x100/0x100 <4> [215.911008] ? lock_release+0xd0/0x2b0 <4> [215.911014] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.911019] process_one_work+0x239/0x760 <4> [215.911026] worker_thread+0x200/0x3f0 <4> [215.911029] ? __pfx_worker_thread+0x10/0x10 <4> [215.911031] kthread+0x10d/0x150 <4> [215.911034] ? __pfx_kthread+0x10/0x10 <4> [215.911038] ret_from_fork+0x3d4/0x480 <4> [215.911040] ? __pfx_kthread+0x10/0x10 <4> [215.911043] ret_from_fork_asm+0x1a/0x30 <4> [215.911050] </TASK> <4> [215.911051] irq event stamp: 1042897 <4> [215.911052] hardirqs last enabled at (1042903): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.911055] hardirqs last disabled at (1042908): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.911057] softirqs last enabled at (1042148): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.911059] softirqs last disabled at (1042131): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.911061] ---[ end trace 0000000000000000 ]--- <5> [215.912163] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65508, lrc_seqno=65508, guc_id=0, flags=0x73 in no process [-1] <7> [215.912169] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.912272] ------------[ cut here ]------------ <4> [215.912274] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.912276] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [215.912350] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.912424] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.912429] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.912432] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.912433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.912435] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.912439] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.912509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.912511] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.912513] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.912514] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.912516] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.912517] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.912518] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.912519] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.912521] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.912522] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.912524] PKRU: 55555554 <4> [215.912526] Call Trace: <4> [215.912528] <TASK> <4> [215.912535] ? lock_sync+0x100/0x100 <4> [215.912540] ? lock_release+0xd0/0x2b0 <4> [215.912545] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.912551] process_one_work+0x239/0x760 <4> [215.912557] worker_thread+0x200/0x3f0 <4> [215.912560] ? __pfx_worker_thread+0x10/0x10 <4> [215.912562] kthread+0x10d/0x150 <4> [215.912565] ? __pfx_kthread+0x10/0x10 <4> [215.912569] ret_from_fork+0x3d4/0x480 <4> [215.912570] ? __pfx_kthread+0x10/0x10 <4> [215.912574] ret_from_fork_asm+0x1a/0x30 <4> [215.912581] </TASK> <4> [215.912582] irq event stamp: 761415 <4> [215.912583] hardirqs last enabled at (761421): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.912586] hardirqs last disabled at (761426): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.912588] softirqs last enabled at (759716): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.912590] softirqs last disabled at (759577): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.912593] ---[ end trace 0000000000000000 ]--- <7> [215.912543] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [215.912595] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.912665] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.912672] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.912648] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.912857] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.913059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.913147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.913241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.913331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.913419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.913503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.913588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.913672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.913753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.913857] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.913974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.914984] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.924787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.925037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.926209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.926284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.926354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.926425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.926495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.926565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.926633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.926700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.926768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.926863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.926934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.927001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.927068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.927135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.927201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.927269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.927338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.927407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.927474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.927550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.927623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.927695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.927768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.927876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.927958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.928031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.928101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.928172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.928245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.928316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.928388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.928459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.928537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.928614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.928695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.928772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.928865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.928941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.929012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.929081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.929154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.929227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.929301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.929374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.929448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.929518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.929588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.929657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.929727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.929802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.929881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.929957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.930029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.930099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.930168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.930239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.930307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.930375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.930446] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.930555] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.930558] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65508, lrc_seqno=65508, guc_id=0, flags=0x73 in no process [-1] <7> [215.930560] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.930614] ------------[ cut here ]------------ <4> [215.930615] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.930616] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [215.930682] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.930739] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.930743] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.930746] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.930747] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.930748] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.930752] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.930834] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.930836] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.930839] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.930840] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.930842] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.930843] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.930844] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.930846] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.930848] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.930849] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.930851] PKRU: 55555554 <4> [215.930852] Call Trace: <4> [215.930853] <TASK> <4> [215.930857] ? lock_sync+0x100/0x100 <4> [215.930862] ? lock_release+0xd0/0x2b0 <4> [215.930868] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.930873] process_one_work+0x239/0x760 <4> [215.930879] worker_thread+0x200/0x3f0 <4> [215.930882] ? __pfx_worker_thread+0x10/0x10 <4> [215.930885] kthread+0x10d/0x150 <4> [215.930888] ? __pfx_kthread+0x10/0x10 <4> [215.930891] ret_from_fork+0x3d4/0x480 <4> [215.930893] ? __pfx_kthread+0x10/0x10 <4> [215.930896] ret_from_fork_asm+0x1a/0x30 <4> [215.930903] </TASK> <4> [215.930904] irq event stamp: 764581 <4> [215.930905] hardirqs last enabled at (764587): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.930908] hardirqs last disabled at (764592): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.930910] softirqs last enabled at (764420): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.930912] softirqs last disabled at (764415): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.930914] ---[ end trace 0000000000000000 ]--- <6> [215.930916] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.930980] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.930987] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.932007] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.932101] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.932197] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.932394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.932476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.932561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.932640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.932718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.932800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.932884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.932963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.933038] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.933122] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.933230] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.934225] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.944786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.945028] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.946070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.946142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.946210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.946280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.946349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.946418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.946487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.946555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.946626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.946697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.946767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.946854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.946923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.946991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.947058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.947129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.947199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.947268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.947336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.947410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.947484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.947555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.947631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.947704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.947775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.947859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.947928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.947999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.948070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.948144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.948217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.948290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.948368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.948444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.948521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.948595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.948667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.948737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.948818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.948889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.948962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.949031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.949099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.949168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.949242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.949311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.949379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.949449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.949518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.949590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.949663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.949738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.949821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.949900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.949978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.950049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.950118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.950185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.950255] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.950364] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.950368] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65508, lrc_seqno=65508, guc_id=0, flags=0x73 in no process [-1] <7> [215.950370] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.950422] ------------[ cut here ]------------ <4> [215.950423] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.950425] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:143/6175 <4> [215.950489] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.950548] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.950552] CPU: 8 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.950555] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.950556] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.950557] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.950562] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.950624] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.950626] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.950628] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.950629] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.950630] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.950631] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.950632] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.950634] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.950635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.950636] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.950638] PKRU: 55555554 <4> [215.950639] Call Trace: <4> [215.950640] <TASK> <4> [215.950643] ? lock_sync+0x100/0x100 <4> [215.950647] ? lock_release+0xd0/0x2b0 <4> [215.950652] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.950657] process_one_work+0x239/0x760 <4> [215.950663] worker_thread+0x200/0x3f0 <4> [215.950665] ? __pfx_worker_thread+0x10/0x10 <4> [215.950668] kthread+0x10d/0x150 <4> [215.950670] ? __pfx_kthread+0x10/0x10 <4> [215.950673] ret_from_fork+0x3d4/0x480 <4> [215.950675] ? __pfx_kthread+0x10/0x10 <4> [215.950678] ret_from_fork_asm+0x1a/0x30 <4> [215.950685] </TASK> <4> [215.950686] irq event stamp: 1686331 <4> [215.950687] hardirqs last enabled at (1686337): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.950689] hardirqs last disabled at (1686342): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.950691] softirqs last enabled at (1685348): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.950693] softirqs last disabled at (1685341): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.950695] ---[ end trace 0000000000000000 ]--- <5> [215.951277] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65563, lrc_seqno=65563, guc_id=0, flags=0x73 in no process [-1] <7> [215.951279] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.951340] ------------[ cut here ]------------ <4> [215.951341] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.951342] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:143/6175 <4> [215.951413] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.951476] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.951480] CPU: 8 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.951482] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.951483] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.951485] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.951489] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.951559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.951560] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [215.951563] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.951564] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.951565] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.951566] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.951568] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.951569] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [215.951570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.951572] CR2: 0000592d0aac742c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [215.951573] PKRU: 55555554 <4> [215.951574] Call Trace: <4> [215.951575] <TASK> <4> [215.951579] ? lock_sync+0x100/0x100 <4> [215.951583] ? lock_release+0xd0/0x2b0 <4> [215.951588] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.951594] process_one_work+0x239/0x760 <4> [215.951599] worker_thread+0x200/0x3f0 <4> [215.951602] ? __pfx_worker_thread+0x10/0x10 <4> [215.951604] kthread+0x10d/0x150 <4> [215.951607] ? __pfx_kthread+0x10/0x10 <4> [215.951611] ret_from_fork+0x3d4/0x480 <4> [215.951613] ? __pfx_kthread+0x10/0x10 <4> [215.951616] ret_from_fork_asm+0x1a/0x30 <4> [215.951623] </TASK> <4> [215.951624] irq event stamp: 1689041 <4> [215.951625] hardirqs last enabled at (1689047): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.951628] hardirqs last disabled at (1689052): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.951630] softirqs last enabled at (1685348): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.951632] softirqs last disabled at (1685341): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.951635] ---[ end trace 0000000000000000 ]--- <6> [215.951636] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.951705] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.951711] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.952729] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.952844] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.952949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.953157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.953249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.953343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.953431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.953517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.953602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.953687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.953773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.953892] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.953992] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.954111] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.955118] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.965787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.966034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.967110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.967183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.967253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.967323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.967391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.967466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.967535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.967601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.967668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.967735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.967817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.967918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.968000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.968069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.968140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.968209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.968278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.968345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.968411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.968486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.968559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.968632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.968704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.968784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.968878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.968950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.969020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.969093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.969165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.969237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.969309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.969380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.969457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.969537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.969618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.969694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.969767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.969864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.969949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.970018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.970091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.970162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.970231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.970301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.970372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.970441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.970509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.970578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.970648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.970715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.970789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.970880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.970953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.971026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.971098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.971171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.971241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.971310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.971383] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.971488] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.971492] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65563, lrc_seqno=65563, guc_id=0, flags=0x73 in no process [-1] <7> [215.971494] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.971547] ------------[ cut here ]------------ <4> [215.971548] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.971550] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [215.971614] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.971672] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.971677] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.971680] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.971681] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.971682] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.971687] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.971750] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.971751] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [215.971754] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.971755] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.971756] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.971757] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.971758] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.971760] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [215.971761] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.971762] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [215.971764] PKRU: 55555554 <4> [215.971765] Call Trace: <4> [215.971766] <TASK> <4> [215.971769] ? lock_sync+0x100/0x100 <4> [215.971774] ? lock_release+0xd0/0x2b0 <4> [215.971785] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.971794] process_one_work+0x239/0x760 <4> [215.971805] worker_thread+0x200/0x3f0 <4> [215.971810] ? __pfx_worker_thread+0x10/0x10 <4> [215.971813] kthread+0x10d/0x150 <4> [215.971818] ? __pfx_kthread+0x10/0x10 <4> [215.971823] ret_from_fork+0x3d4/0x480 <4> [215.971826] ? __pfx_kthread+0x10/0x10 <4> [215.971831] ret_from_fork_asm+0x1a/0x30 <4> [215.971843] </TASK> <4> [215.971845] irq event stamp: 1048601 <4> [215.971847] hardirqs last enabled at (1048607): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.971850] hardirqs last disabled at (1048612): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.971854] softirqs last enabled at (1047698): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.971858] softirqs last disabled at (1047691): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.971861] ---[ end trace 0000000000000000 ]--- <6> [215.971864] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.971939] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.971945] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.973069] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.973167] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [215.973264] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.973461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.973542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.973628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.973709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.973801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.973893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.973974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.974055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.974130] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.974214] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.974320] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.975316] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [215.986031] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [215.986272] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [215.987260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [215.987332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [215.987401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [215.987469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [215.987537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [215.987606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [215.987676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [215.987744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [215.987824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [215.987897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [215.987970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [215.988040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [215.988105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [215.988170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [215.988237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [215.988303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [215.988370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [215.988436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [215.988501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [215.988577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [215.988651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [215.988721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [215.988801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [215.988877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [215.988950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [215.989018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [215.989088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [215.989160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [215.989231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [215.989302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [215.989372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [215.989443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [215.989518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [215.989593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [215.989668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [215.989740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [215.989830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [215.989911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [215.989987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [215.990057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [215.990130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [215.990201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [215.990270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [215.990339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [215.990411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [215.990480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [215.990550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [215.990620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [215.990692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [215.990764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [215.990851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [215.990932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [215.991010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [215.991086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [215.991162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [215.991240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [215.991315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [215.991390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [215.991469] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [215.991584] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [215.991588] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65563, lrc_seqno=65563, guc_id=0, flags=0x73 in no process [-1] <7> [215.991591] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.991649] ------------[ cut here ]------------ <4> [215.991650] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.991652] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [215.991724] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.991793] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.991798] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.991801] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.991803] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.991804] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.991809] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.991879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.991881] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.991883] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.991885] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.991886] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.991887] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.991888] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.991890] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.991891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.991893] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.991894] PKRU: 55555554 <4> [215.991895] Call Trace: <4> [215.991897] <TASK> <4> [215.991901] ? lock_sync+0x100/0x100 <4> [215.991905] ? lock_release+0xd0/0x2b0 <4> [215.991910] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.991916] process_one_work+0x239/0x760 <4> [215.991922] worker_thread+0x200/0x3f0 <4> [215.991925] ? __pfx_worker_thread+0x10/0x10 <4> [215.991927] kthread+0x10d/0x150 <4> [215.991930] ? __pfx_kthread+0x10/0x10 <4> [215.991934] ret_from_fork+0x3d4/0x480 <4> [215.991936] ? __pfx_kthread+0x10/0x10 <4> [215.991939] ret_from_fork_asm+0x1a/0x30 <4> [215.991946] </TASK> <4> [215.991947] irq event stamp: 768009 <4> [215.991948] hardirqs last enabled at (768015): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.991951] hardirqs last disabled at (768020): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.991954] softirqs last enabled at (767008): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.991956] softirqs last disabled at (766999): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.991958] ---[ end trace 0000000000000000 ]--- <5> [215.993570] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65618, lrc_seqno=65618, guc_id=0, flags=0x73 in no process [-1] <7> [215.993573] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [215.993634] ------------[ cut here ]------------ <4> [215.993636] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [215.993637] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [215.993711] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [215.993774] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [215.993784] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [215.993788] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [215.993790] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [215.993793] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [215.993798] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [215.993868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [215.993869] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [215.993871] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [215.993873] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [215.993874] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [215.993875] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [215.993876] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [215.993877] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [215.993879] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [215.993880] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [215.993882] PKRU: 55555554 <4> [215.993883] Call Trace: <4> [215.993884] <TASK> <4> [215.993887] ? lock_sync+0x100/0x100 <4> [215.993892] ? lock_release+0xd0/0x2b0 <4> [215.993897] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [215.993902] process_one_work+0x239/0x760 <4> [215.993908] worker_thread+0x200/0x3f0 <4> [215.993911] ? __pfx_worker_thread+0x10/0x10 <4> [215.993913] kthread+0x10d/0x150 <4> [215.993916] ? __pfx_kthread+0x10/0x10 <4> [215.993920] ret_from_fork+0x3d4/0x480 <4> [215.993922] ? __pfx_kthread+0x10/0x10 <4> [215.993925] ret_from_fork_asm+0x1a/0x30 <4> [215.993932] </TASK> <4> [215.993933] irq event stamp: 770817 <4> [215.993934] hardirqs last enabled at (770823): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [215.993937] hardirqs last disabled at (770828): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [215.993939] softirqs last enabled at (767008): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.993941] softirqs last disabled at (766999): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [215.993944] ---[ end trace 0000000000000000 ]--- <7> [215.993956] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [215.994059] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [215.994160] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [215.994233] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [215.994240] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [215.994288] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [215.994489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [215.994579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [215.994672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [215.994760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [215.994862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [215.994948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [215.995038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [215.995126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [215.995208] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [215.995304] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [215.995421] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [215.996428] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.006788] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.007040] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.008124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.008202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.008279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.008358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.008436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.008513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.008587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.008661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.008735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.008819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.008896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.008974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.009049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.009123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.009198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.009270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.009343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.009415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.009487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.009568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.009650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.009729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.009824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.009905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.009983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.010060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.010136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.010216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.010295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.010375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.010457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.010537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.010621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.010705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.010793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.010872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.010950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.011025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.011100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.011174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.011252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.011329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.011405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.011482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.011567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.011648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.011725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.011810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.011888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.011962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.012036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.012117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.012194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.012270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.012345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.012424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.012502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.012578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.012656] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.012771] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.012775] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65618, lrc_seqno=65618, guc_id=0, flags=0x73 in no process [-1] <7> [216.013623] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.013683] ------------[ cut here ]------------ <4> [216.013684] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.013685] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [216.013756] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.013831] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.013836] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.013839] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.013840] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.013841] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.013846] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.013916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.013918] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.013920] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.013922] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.013923] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.013924] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.013925] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.013927] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [216.013928] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.013930] CR2: 00007aa42b9ff000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.013931] PKRU: 55555554 <4> [216.013932] Call Trace: <4> [216.013933] <TASK> <4> [216.013937] ? lock_sync+0x100/0x100 <4> [216.013941] ? lock_release+0xd0/0x2b0 <4> [216.013947] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.013952] process_one_work+0x239/0x760 <4> [216.013958] worker_thread+0x200/0x3f0 <4> [216.013961] ? __pfx_worker_thread+0x10/0x10 <4> [216.013963] kthread+0x10d/0x150 <4> [216.013966] ? __pfx_kthread+0x10/0x10 <4> [216.013970] ret_from_fork+0x3d4/0x480 <4> [216.013972] ? __pfx_kthread+0x10/0x10 <4> [216.013975] ret_from_fork_asm+0x1a/0x30 <4> [216.013982] </TASK> <4> [216.013984] irq event stamp: 773935 <4> [216.013985] hardirqs last enabled at (773941): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.013987] hardirqs last disabled at (773946): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.013990] softirqs last enabled at (772720): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.013992] softirqs last disabled at (772715): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.013994] ---[ end trace 0000000000000000 ]--- <6> [216.013996] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.014068] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.014074] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.014086] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.014188] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.014484] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.014693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.014822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.014920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.015010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.015100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.015186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.015271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.015358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.015438] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.015534] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.015653] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.016675] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.026795] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.027054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.028108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.028194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.028270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.028345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.028421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.028496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.028570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.028644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.028717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.028796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.028868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.028942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.029019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.029095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.029169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.029244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.029318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.029392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.029466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.029546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.029627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.029708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.029802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.029878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.029953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.030030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.030107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.030184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.030262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.030338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.030416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.030493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.030576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.030662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.030749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.030841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.030921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.031001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.031077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.031153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.031232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.031309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.031387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.031468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.031551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.031629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.031707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.031787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.031868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.031946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.032025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.032105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.032181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.032258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.032334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.032411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.032488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.032568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.032650] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.032762] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.032766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65618, lrc_seqno=65618, guc_id=0, flags=0x73 in no process [-1] <7> [216.032768] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.032852] ------------[ cut here ]------------ <4> [216.032853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.032855] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.032926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.032989] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.032994] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.032997] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.032998] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.032999] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.033004] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.033074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.033076] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.033078] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.033079] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.033081] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.033082] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.033083] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.033084] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.033086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.033087] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.033089] PKRU: 55555554 <4> [216.033090] Call Trace: <4> [216.033091] <TASK> <4> [216.033095] ? lock_sync+0x100/0x100 <4> [216.033099] ? lock_release+0xd0/0x2b0 <4> [216.033105] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.033110] process_one_work+0x239/0x760 <4> [216.033116] worker_thread+0x200/0x3f0 <4> [216.033119] ? __pfx_worker_thread+0x10/0x10 <4> [216.033121] kthread+0x10d/0x150 <4> [216.033124] ? __pfx_kthread+0x10/0x10 <4> [216.033128] ret_from_fork+0x3d4/0x480 <4> [216.033130] ? __pfx_kthread+0x10/0x10 <4> [216.033133] ret_from_fork_asm+0x1a/0x30 <4> [216.033141] </TASK> <4> [216.033142] irq event stamp: 1052145 <4> [216.033143] hardirqs last enabled at (1052151): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.033146] hardirqs last disabled at (1052156): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.033148] softirqs last enabled at (1051378): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.033150] softirqs last disabled at (1051361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.033153] ---[ end trace 0000000000000000 ]--- <5> [216.033722] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65673, lrc_seqno=65673, guc_id=0, flags=0x73 in no process [-1] <7> [216.033725] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.034783] ------------[ cut here ]------------ <4> [216.034784] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.034786] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.034864] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.034927] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.034931] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.034934] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.034935] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.034936] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.034941] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.035024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.035027] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.035032] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.035035] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.035038] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.035040] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.035043] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.035046] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.035049] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.035051] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.035054] PKRU: 55555554 <4> [216.035056] Call Trace: <4> [216.035059] <TASK> <4> [216.035063] ? lock_sync+0x100/0x100 <4> [216.035070] ? lock_release+0xd0/0x2b0 <4> [216.035081] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.035093] process_one_work+0x239/0x760 <4> [216.035106] worker_thread+0x200/0x3f0 <4> [216.035112] ? __pfx_worker_thread+0x10/0x10 <4> [216.035116] kthread+0x10d/0x150 <4> [216.035122] ? __pfx_kthread+0x10/0x10 <4> [216.035129] ret_from_fork+0x3d4/0x480 <4> [216.035132] ? __pfx_kthread+0x10/0x10 <4> [216.035136] ret_from_fork_asm+0x1a/0x30 <4> [216.035144] </TASK> <4> [216.035145] irq event stamp: 1054843 <4> [216.035147] hardirqs last enabled at (1054849): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.035150] hardirqs last disabled at (1054854): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.035152] softirqs last enabled at (1054068): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.035155] softirqs last disabled at (1054061): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.035158] ---[ end trace 0000000000000000 ]--- <6> [216.035160] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.035241] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.035247] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.035260] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.035365] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.035470] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.035676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.035767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.035921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.036010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.036099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.036187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.036274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.036361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.036444] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.036538] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.036653] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.037670] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.047823] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.048072] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.049126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.049204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.049272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.049341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.049410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.049479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.049547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.049615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.049684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.049754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.049843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.049928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.050004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.050078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.050152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.050225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.050298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.050371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.050443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.050523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.050604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.050684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.050765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.050859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.050947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.051023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.051099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.051178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.051260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.051342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.051423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.051503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.051587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.051671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.051754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.051849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.051937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.052015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.052095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.052172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.052252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.052330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.052407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.052482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.052562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.052638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.052714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.052796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.052887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.052963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.053039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.053119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.053196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.053272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.053349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.053430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.053508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.053584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.053664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.053792] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.053800] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65673, lrc_seqno=65673, guc_id=0, flags=0x73 in no process [-1] <7> [216.053803] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.053905] ------------[ cut here ]------------ <4> [216.053907] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.053960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.054036] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.054107] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.054113] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.054117] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.054118] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.054119] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.054126] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.054203] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.054204] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.054207] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.054208] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.054210] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.054211] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.054212] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.054214] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.054215] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.054216] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.054218] PKRU: 55555554 <4> [216.054219] Call Trace: <4> [216.054221] <TASK> <4> [216.054224] ? lock_sync+0x100/0x100 <4> [216.054229] ? lock_release+0xd0/0x2b0 <4> [216.054235] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.054241] process_one_work+0x239/0x760 <4> [216.054249] worker_thread+0x200/0x3f0 <4> [216.054252] ? __pfx_worker_thread+0x10/0x10 <4> [216.054254] kthread+0x10d/0x150 <4> [216.054258] ? __pfx_kthread+0x10/0x10 <4> [216.054261] ret_from_fork+0x3d4/0x480 <4> [216.054263] ? __pfx_kthread+0x10/0x10 <4> [216.054266] ret_from_fork_asm+0x1a/0x30 <4> [216.054274] </TASK> <4> [216.054276] irq event stamp: 1696973 <4> [216.054277] hardirqs last enabled at (1696979): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.054280] hardirqs last disabled at (1696984): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.054283] softirqs last enabled at (1695962): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.054285] softirqs last disabled at (1695955): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.054287] ---[ end trace 0000000000000000 ]--- <6> [216.054291] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.054370] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.054383] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.054729] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.054872] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.054982] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.055185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.055276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.055369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.055457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.055544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.055632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.055720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.055818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.055901] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.055996] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.056111] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.057118] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.067788] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.068050] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.069124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.069205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.069281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.069358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.069433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.069509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.069586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.069663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.069739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.069826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.069900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.069973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.070045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.070119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.070195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.070271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.070347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.070421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.070496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.070578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.070659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.070737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.070827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.070908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.070989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.071067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.071144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.071222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.071305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.071387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.071467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.071546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.071629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.071712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.071801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.071885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.071968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.072045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.072122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.072197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.072276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.072354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.072434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.072513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.072595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.072672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.072749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.072840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.072917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.072991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.073069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.073151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.073228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.073306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.073384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.073460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.073536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.073612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.073690] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.073807] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.073811] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65673, lrc_seqno=65673, guc_id=0, flags=0x73 in no process [-1] <7> [216.073814] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.073872] ------------[ cut here ]------------ <4> [216.073873] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.073875] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.073947] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.074022] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.074027] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.074030] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.074032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.074033] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.074039] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.074109] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.074111] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.074114] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.074115] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.074117] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.074118] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.074119] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.074120] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.074122] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.074123] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.074125] PKRU: 55555554 <4> [216.074126] Call Trace: <4> [216.074127] <TASK> <4> [216.074131] ? lock_sync+0x100/0x100 <4> [216.074135] ? lock_release+0xd0/0x2b0 <4> [216.074141] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.074147] process_one_work+0x239/0x760 <4> [216.074153] worker_thread+0x200/0x3f0 <4> [216.074155] ? __pfx_worker_thread+0x10/0x10 <4> [216.074158] kthread+0x10d/0x150 <4> [216.074161] ? __pfx_kthread+0x10/0x10 <4> [216.074164] ret_from_fork+0x3d4/0x480 <4> [216.074166] ? __pfx_kthread+0x10/0x10 <4> [216.074169] ret_from_fork_asm+0x1a/0x30 <4> [216.074177] </TASK> <4> [216.074178] irq event stamp: 1700103 <4> [216.074179] hardirqs last enabled at (1700109): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.074182] hardirqs last disabled at (1700114): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.074184] softirqs last enabled at (1698994): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.074187] softirqs last disabled at (1698987): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.074189] ---[ end trace 0000000000000000 ]--- <5> [216.074797] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65728, lrc_seqno=65728, guc_id=0, flags=0x73 in no process [-1] <7> [216.074801] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.074908] ------------[ cut here ]------------ <4> [216.074910] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.074911] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [216.074987] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.075060] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.075066] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.075070] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.075071] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.075073] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.075080] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.075156] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.075158] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.075160] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.075162] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.075163] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.075164] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.075165] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.075167] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [216.075168] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.075170] CR2: 00007b785fbe0000 CR3: 000000013970b006 CR4: 0000000000f72ef0 <4> [216.075171] PKRU: 55555554 <4> [216.075172] Call Trace: <4> [216.075174] <TASK> <4> [216.075178] ? lock_sync+0x100/0x100 <4> [216.075183] ? lock_release+0xd0/0x2b0 <4> [216.075189] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.075195] process_one_work+0x239/0x760 <4> [216.075203] worker_thread+0x200/0x3f0 <4> [216.075205] ? __pfx_worker_thread+0x10/0x10 <4> [216.075208] kthread+0x10d/0x150 <4> [216.075211] ? __pfx_kthread+0x10/0x10 <4> [216.075215] ret_from_fork+0x3d4/0x480 <4> [216.075217] ? __pfx_kthread+0x10/0x10 <4> [216.075221] ret_from_fork_asm+0x1a/0x30 <4> [216.075230] </TASK> <4> [216.075231] irq event stamp: 1056793 <4> [216.075232] hardirqs last enabled at (1056799): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.075236] hardirqs last disabled at (1056804): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.075238] softirqs last enabled at (1055976): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.075241] softirqs last disabled at (1055961): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.075244] ---[ end trace 0000000000000000 ]--- <6> [216.075246] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.075329] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.075718] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.075733] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.075853] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.076017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.076222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.076313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.076407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.076495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.076581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.076665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.076749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.076845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.076928] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.077022] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.077137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.078147] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.089125] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.089377] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.090466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.090539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.090607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.090677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.090745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.090828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.090904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.090980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.091055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.091132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.091209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.091286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.091362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.091436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.091510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.091583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.091657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.091730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.091810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.091893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.091975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.092056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.092134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.092211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.092287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.092364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.092439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.092518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.092597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.092675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.092753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.092839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.092923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.093006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.093091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.093171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.093250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.093327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.093403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.093479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.093562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.093643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.093720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.093799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.093879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.093955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.094032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.094107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.094183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.094257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.094333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.094410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.094486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.094563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.094639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.094721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.094803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.094880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.094958] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.095071] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.095075] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65728, lrc_seqno=65728, guc_id=0, flags=0x73 in no process [-1] <7> [216.095077] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.095136] ------------[ cut here ]------------ <4> [216.095137] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.095138] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [216.095209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.095272] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.095276] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.095279] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.095280] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.095282] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.095286] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.095357] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.095358] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.095361] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.095362] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.095364] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.095365] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.095366] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.095367] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [216.095369] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.095370] CR2: 00007b785fbe0000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.095372] PKRU: 55555554 <4> [216.095373] Call Trace: <4> [216.095374] <TASK> <4> [216.095378] ? lock_sync+0x100/0x100 <4> [216.095382] ? lock_release+0xd0/0x2b0 <4> [216.095388] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.095393] process_one_work+0x239/0x760 <4> [216.095399] worker_thread+0x200/0x3f0 <4> [216.095402] ? __pfx_worker_thread+0x10/0x10 <4> [216.095404] kthread+0x10d/0x150 <4> [216.095407] ? __pfx_kthread+0x10/0x10 <4> [216.095411] ret_from_fork+0x3d4/0x480 <4> [216.095413] ? __pfx_kthread+0x10/0x10 <4> [216.095416] ret_from_fork_asm+0x1a/0x30 <4> [216.095424] </TASK> <4> [216.095425] irq event stamp: 1059925 <4> [216.095426] hardirqs last enabled at (1059931): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.095429] hardirqs last disabled at (1059936): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.095431] softirqs last enabled at (1058788): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.095433] softirqs last disabled at (1058781): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.095435] ---[ end trace 0000000000000000 ]--- <6> [216.095437] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.095508] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.095514] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.096756] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.096870] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.096974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.097181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.097275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.097368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.097460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.097547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.097632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.097718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.097815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.097898] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.097992] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.098110] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.099118] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.109787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.110055] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.111121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.111199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.111276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.111354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.111431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.111507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.111582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.111658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.111733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.111826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.111904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.111980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.112055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.112129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.112204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.112278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.112353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.112426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.112500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.112582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.112661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.112742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.112832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.112911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.112989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.113064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.113139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.113218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.113300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.113380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.113461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.113540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.113624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.113707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.113796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.113878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.113961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.114040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.114116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.114192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.114270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.114348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.114424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.114499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.114577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.114653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.114730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.114814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.114893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.114971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.115048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.115127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.115204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.115281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.115357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.115437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.115517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.115595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.115675] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.115802] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.115807] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65728, lrc_seqno=65728, guc_id=0, flags=0x73 in no process [-1] <7> [216.115809] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.115867] ------------[ cut here ]------------ <4> [216.115869] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.115870] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.115941] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.116004] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.116008] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.116011] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.116013] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.116014] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.116019] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.116088] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.116090] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.116092] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.116093] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.116095] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.116096] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.116097] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.116098] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.116100] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.116101] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.116103] PKRU: 55555554 <4> [216.116104] Call Trace: <4> [216.116105] <TASK> <4> [216.116109] ? lock_sync+0x100/0x100 <4> [216.116113] ? lock_release+0xd0/0x2b0 <4> [216.116119] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.116124] process_one_work+0x239/0x760 <4> [216.116131] worker_thread+0x200/0x3f0 <4> [216.116133] ? __pfx_worker_thread+0x10/0x10 <4> [216.116136] kthread+0x10d/0x150 <4> [216.116139] ? __pfx_kthread+0x10/0x10 <4> [216.116142] ret_from_fork+0x3d4/0x480 <4> [216.116144] ? __pfx_kthread+0x10/0x10 <4> [216.116148] ret_from_fork_asm+0x1a/0x30 <4> [216.116155] </TASK> <4> [216.116156] irq event stamp: 1705719 <4> [216.116157] hardirqs last enabled at (1705725): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.116160] hardirqs last disabled at (1705730): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.116163] softirqs last enabled at (1704918): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.116165] softirqs last disabled at (1704861): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.116167] ---[ end trace 0000000000000000 ]--- <5> [216.116751] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65783, lrc_seqno=65783, guc_id=0, flags=0x73 in no process [-1] <7> [216.116754] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.117791] ------------[ cut here ]------------ <4> [216.117793] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.117795] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.117866] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.117928] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.117932] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.117935] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.117936] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.117937] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.117942] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.118010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.118012] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.118014] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.118015] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.118016] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.118018] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.118019] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.118020] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.118022] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.118023] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.118024] PKRU: 55555554 <4> [216.118025] Call Trace: <4> [216.118026] <TASK> <4> [216.118030] ? lock_sync+0x100/0x100 <4> [216.118034] ? lock_release+0xd0/0x2b0 <4> [216.118040] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.118045] process_one_work+0x239/0x760 <4> [216.118051] worker_thread+0x200/0x3f0 <4> [216.118054] ? __pfx_worker_thread+0x10/0x10 <4> [216.118056] kthread+0x10d/0x150 <4> [216.118059] ? __pfx_kthread+0x10/0x10 <4> [216.118063] ret_from_fork+0x3d4/0x480 <4> [216.118065] ? __pfx_kthread+0x10/0x10 <4> [216.118068] ret_from_fork_asm+0x1a/0x30 <4> [216.118075] </TASK> <4> [216.118076] irq event stamp: 1708365 <4> [216.118077] hardirqs last enabled at (1708371): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.118080] hardirqs last disabled at (1708376): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.118082] softirqs last enabled at (1707594): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.118084] softirqs last disabled at (1707587): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.118087] ---[ end trace 0000000000000000 ]--- <6> [216.118088] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.118161] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.118167] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.118181] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.118284] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.118388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.118593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.118683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.118781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.118874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.118964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.119050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.119136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.119221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.119301] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.119395] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.119512] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.120533] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.130785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.131035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.132066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.132145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.132218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.132288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.132357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.132427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.132495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.132563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.132632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.132702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.132771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.132858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.132934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.133009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.133082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.133155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.133228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.133302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.133374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.133456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.133537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.133615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.133695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.133773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.133892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.133970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.134051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.134136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.134217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.134297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.134376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.134456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.134540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.134623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.134709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.134797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.134880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.134958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.135035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.135109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.135189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.135270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.135352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.135430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.135512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.135589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.135666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.135743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.135828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.135903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.135982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.136064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.136143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.136221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.136298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.136376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.136451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.136525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.136603] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.136715] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.136719] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65783, lrc_seqno=65783, guc_id=0, flags=0x73 in no process [-1] <7> [216.136721] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.136783] ------------[ cut here ]------------ <4> [216.136785] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.136786] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [216.136858] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.136921] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.136926] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.136929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.136930] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.136931] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.136936] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.137005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.137007] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.137009] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.137011] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.137012] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.137013] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.137015] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.137016] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [216.137017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.137019] CR2: 00007b785fbe0000 CR3: 0000000110678004 CR4: 0000000000f72ef0 <4> [216.137020] PKRU: 55555554 <4> [216.137021] Call Trace: <4> [216.137022] <TASK> <4> [216.137026] ? lock_sync+0x100/0x100 <4> [216.137031] ? lock_release+0xd0/0x2b0 <4> [216.137036] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.137042] process_one_work+0x239/0x760 <4> [216.137048] worker_thread+0x200/0x3f0 <4> [216.137050] ? __pfx_worker_thread+0x10/0x10 <4> [216.137053] kthread+0x10d/0x150 <4> [216.137056] ? __pfx_kthread+0x10/0x10 <4> [216.137059] ret_from_fork+0x3d4/0x480 <4> [216.137061] ? __pfx_kthread+0x10/0x10 <4> [216.137064] ret_from_fork_asm+0x1a/0x30 <4> [216.137072] </TASK> <4> [216.137073] irq event stamp: 1065485 <4> [216.137074] hardirqs last enabled at (1065491): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.137077] hardirqs last disabled at (1065496): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.137079] softirqs last enabled at (1064476): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.137081] softirqs last disabled at (1064469): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.137084] ---[ end trace 0000000000000000 ]--- <6> [216.137085] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.137155] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.137161] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.138401] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.138505] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.138609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.138817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.138907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.139000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.139088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.139188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.139273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.139358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.139444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.139525] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.139620] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.139736] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.140750] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.150786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.151043] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.152105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.152183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.152258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.152335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.152413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.152490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.152565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.152640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.152714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.152791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.152865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.152941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.153017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.153091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.153165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.153240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.153314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.153387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.153461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.153545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.153628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.153707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.153790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.153869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.153944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.154021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.154099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.154178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.154257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.154334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.154417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.154500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.154585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.154670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.154754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.154843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.154922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.154999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.155075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.155150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.155230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.155307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.155383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.155458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.155537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.155613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.155689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.155764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.155858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.155934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.156010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.156093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.156173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.156251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.156328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.156405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.156481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.156556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.156634] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.156745] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.156749] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65783, lrc_seqno=65783, guc_id=0, flags=0x73 in no process [-1] <7> [216.156751] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.156822] ------------[ cut here ]------------ <4> [216.156823] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.156825] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.156895] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.156958] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.156962] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.156965] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.156966] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.156968] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.156973] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.157041] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.157043] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.157045] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.157047] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.157048] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.157049] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.157050] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.157052] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.157053] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.157055] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.157056] PKRU: 55555554 <4> [216.157057] Call Trace: <4> [216.157058] <TASK> <4> [216.157062] ? lock_sync+0x100/0x100 <4> [216.157066] ? lock_release+0xd0/0x2b0 <4> [216.157072] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.157077] process_one_work+0x239/0x760 <4> [216.157083] worker_thread+0x200/0x3f0 <4> [216.157086] ? __pfx_worker_thread+0x10/0x10 <4> [216.157089] kthread+0x10d/0x150 <4> [216.157091] ? __pfx_kthread+0x10/0x10 <4> [216.157095] ret_from_fork+0x3d4/0x480 <4> [216.157097] ? __pfx_kthread+0x10/0x10 <4> [216.157100] ret_from_fork_asm+0x1a/0x30 <4> [216.157108] </TASK> <4> [216.157109] irq event stamp: 1711801 <4> [216.157110] hardirqs last enabled at (1711807): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.157113] hardirqs last disabled at (1711812): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.157115] softirqs last enabled at (1710886): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.157117] softirqs last disabled at (1710879): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.157120] ---[ end trace 0000000000000000 ]--- <5> [216.157700] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65838, lrc_seqno=65838, guc_id=0, flags=0x73 in no process [-1] <7> [216.157703] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.157763] ------------[ cut here ]------------ <4> [216.157765] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.157766] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.157853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.157916] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.157920] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.157923] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.157924] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.157925] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.157930] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.158000] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.158001] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.158003] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.158004] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.158005] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.158007] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.158008] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.158009] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.158010] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.158012] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.158013] PKRU: 55555554 <4> [216.158014] Call Trace: <4> [216.158015] <TASK> <4> [216.158019] ? lock_sync+0x100/0x100 <4> [216.158023] ? lock_release+0xd0/0x2b0 <4> [216.158028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.158034] process_one_work+0x239/0x760 <4> [216.158039] worker_thread+0x200/0x3f0 <4> [216.158042] ? __pfx_worker_thread+0x10/0x10 <4> [216.158044] kthread+0x10d/0x150 <4> [216.158047] ? __pfx_kthread+0x10/0x10 <4> [216.158051] ret_from_fork+0x3d4/0x480 <4> [216.158053] ? __pfx_kthread+0x10/0x10 <4> [216.158056] ret_from_fork_asm+0x1a/0x30 <4> [216.158063] </TASK> <4> [216.158064] irq event stamp: 1714441 <4> [216.158065] hardirqs last enabled at (1714447): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.158068] hardirqs last disabled at (1714452): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.158070] softirqs last enabled at (1710886): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.158073] softirqs last disabled at (1710879): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.158075] ---[ end trace 0000000000000000 ]--- <6> [216.159048] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.159133] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.159140] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.159156] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.159266] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.159371] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.159575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.159665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.159758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.159853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.159938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.160022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.160105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.160190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.160269] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.160362] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.160477] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.161482] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.171785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.172034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.173091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.173170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.173246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.173324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.173401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.173479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.173554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.173628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.173703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.173781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.173855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.173927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.174001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.174074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.174147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.174220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.174295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.174370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.174445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.174527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.174608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.174685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.174763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.174851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.174928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.175003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.175079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.175159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.175241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.175320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.175400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.175478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.175562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.175647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.175736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.175827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.175907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.175984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.176062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.176139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.176220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.176304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.176384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.176462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.176543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.176621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.176701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.176782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.176862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.176938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.177014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.177094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.177171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.177248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.177324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.177401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.177476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.177552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.177630] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.177742] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.177746] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65838, lrc_seqno=65838, guc_id=0, flags=0x73 in no process [-1] <7> [216.177748] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.177852] ------------[ cut here ]------------ <4> [216.177853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.177855] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [216.177926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.177990] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.177994] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.177997] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.177998] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.177999] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.178004] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.178075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.178077] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.178079] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.178080] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.178081] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.178083] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.178084] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.178085] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [216.178087] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.178088] CR2: 00007b785fbe0000 CR3: 0000000110678004 CR4: 0000000000f72ef0 <4> [216.178090] PKRU: 55555554 <4> [216.178091] Call Trace: <4> [216.178092] <TASK> <4> [216.178096] ? lock_sync+0x100/0x100 <4> [216.178100] ? lock_release+0xd0/0x2b0 <4> [216.178106] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.178111] process_one_work+0x239/0x760 <4> [216.178118] worker_thread+0x200/0x3f0 <4> [216.178120] ? __pfx_worker_thread+0x10/0x10 <4> [216.178123] kthread+0x10d/0x150 <4> [216.178125] ? __pfx_kthread+0x10/0x10 <4> [216.178129] ret_from_fork+0x3d4/0x480 <4> [216.178131] ? __pfx_kthread+0x10/0x10 <4> [216.178134] ret_from_fork_asm+0x1a/0x30 <4> [216.178142] </TASK> <4> [216.178143] irq event stamp: 1071149 <4> [216.178144] hardirqs last enabled at (1071155): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.178147] hardirqs last disabled at (1071160): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.178149] softirqs last enabled at (1070382): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.178152] softirqs last disabled at (1070159): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.178154] ---[ end trace 0000000000000000 ]--- <6> [216.178156] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.178228] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.178234] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.179469] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.179574] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.179690] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.179944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.180052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.180152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.180245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.180336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.180425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.180515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.180606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.180691] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.180800] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.180923] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.181952] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.192737] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.193059] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.194099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.194186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.194267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.194347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.194428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.194508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.194591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.194671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.194749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.194837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.194915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.194993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.195071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.195148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.195227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.195304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.195381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.195459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.195536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.195622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.195708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.195795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.195881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.195963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.196044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.196126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.196207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.196292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.196377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.196459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.196539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.196621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.196708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.196797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.196890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.196978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.197065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.197148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.197232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.197317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.197402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.197485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.197568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.197648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.197732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.197819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.197900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.197980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.198064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.198150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.198232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.198317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.198399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.198480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.198561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.198644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.198723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.198807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.198890] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.199007] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.199012] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65838, lrc_seqno=65838, guc_id=0, flags=0x73 in no process [-1] <7> [216.199014] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.199076] ------------[ cut here ]------------ <4> [216.199078] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.199079] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:143/6175 <4> [216.199157] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.199222] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.199226] CPU: 6 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.199229] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.199230] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.199232] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.199237] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.199311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.199312] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.199315] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.199316] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.199318] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.199319] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.199320] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.199322] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [216.199323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.199324] CR2: 00007dbbb9564008 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [216.199326] PKRU: 55555554 <4> [216.199327] Call Trace: <4> [216.199328] <TASK> <4> [216.199332] ? lock_sync+0x100/0x100 <4> [216.199337] ? lock_release+0xd0/0x2b0 <4> [216.199342] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.199348] process_one_work+0x239/0x760 <4> [216.199354] worker_thread+0x200/0x3f0 <4> [216.199357] ? __pfx_worker_thread+0x10/0x10 <4> [216.199359] kthread+0x10d/0x150 <4> [216.199362] ? __pfx_kthread+0x10/0x10 <4> [216.199366] ret_from_fork+0x3d4/0x480 <4> [216.199368] ? __pfx_kthread+0x10/0x10 <4> [216.199371] ret_from_fork_asm+0x1a/0x30 <4> [216.199378] </TASK> <4> [216.199379] irq event stamp: 1717947 <4> [216.199381] hardirqs last enabled at (1717953): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.199384] hardirqs last disabled at (1717958): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.199386] softirqs last enabled at (1716832): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.199388] softirqs last disabled at (1716825): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.199391] ---[ end trace 0000000000000000 ]--- <5> [216.200021] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65893, lrc_seqno=65893, guc_id=0, flags=0x73 in no process [-1] <7> [216.200027] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.200314] ------------[ cut here ]------------ <4> [216.200317] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.200322] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:142/6174 <4> [216.200485] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.200663] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.200676] CPU: 11 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.200682] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.200686] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.200689] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.200700] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.200916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.200920] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.200924] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.200927] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.200929] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.200930] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.200932] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.200934] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.200935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.200937] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.200938] PKRU: 55555554 <4> [216.200939] Call Trace: <4> [216.200940] <TASK> <4> [216.200944] ? lock_sync+0x100/0x100 <4> [216.200950] ? lock_release+0xd0/0x2b0 <4> [216.200956] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.200961] process_one_work+0x239/0x760 <4> [216.200968] worker_thread+0x200/0x3f0 <4> [216.200970] ? __pfx_worker_thread+0x10/0x10 <4> [216.200973] kthread+0x10d/0x150 <4> [216.200976] ? __pfx_kthread+0x10/0x10 <4> [216.200979] ret_from_fork+0x3d4/0x480 <4> [216.200981] ? __pfx_kthread+0x10/0x10 <4> [216.200985] ret_from_fork_asm+0x1a/0x30 <4> [216.200992] </TASK> <4> [216.200993] irq event stamp: 778741 <4> [216.200995] hardirqs last enabled at (778747): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.200998] hardirqs last disabled at (778752): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.201000] softirqs last enabled at (778580): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.201002] softirqs last disabled at (778573): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.201004] ---[ end trace 0000000000000000 ]--- <6> [216.201006] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.201091] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.201097] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.201107] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.201212] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.201347] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.201584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.201674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.201769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.201879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.201969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.202056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.202143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.202229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.202311] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.202405] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.202522] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.203536] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.214137] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.214398] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.215472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.215552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.215629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.215706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.215787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.215866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.215945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.216028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.216105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.216180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.216254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.216326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.216399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.216473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.216545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.216617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.216689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.216761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.216847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.216927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.217007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.217085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.217165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.217246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.217324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.217402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.217479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.217557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.217634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.217714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.217801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.217883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.217967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.218050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.218132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.218215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.218294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.218374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.218455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.218534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.218616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.218695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.218773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.218864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.218946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.219027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.219107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.219184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.219263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.219343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.219422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.219504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.219582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.219662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.219741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.219829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.219906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.219980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.220059] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.220171] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.220175] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65893, lrc_seqno=65893, guc_id=0, flags=0x73 in no process [-1] <7> [216.220178] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.220236] ------------[ cut here ]------------ <4> [216.220237] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.220238] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:142/6174 <4> [216.220310] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.220374] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.220378] CPU: 11 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.220381] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.220382] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.220384] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.220389] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.220459] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.220461] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.220463] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.220465] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.220466] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.220467] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.220469] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.220470] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.220472] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.220473] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.220475] PKRU: 55555554 <4> [216.220476] Call Trace: <4> [216.220477] <TASK> <4> [216.220481] ? lock_sync+0x100/0x100 <4> [216.220485] ? lock_release+0xd0/0x2b0 <4> [216.220490] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.220496] process_one_work+0x239/0x760 <4> [216.220502] worker_thread+0x200/0x3f0 <4> [216.220505] ? __pfx_worker_thread+0x10/0x10 <4> [216.220507] kthread+0x10d/0x150 <4> [216.220510] ? __pfx_kthread+0x10/0x10 <4> [216.220513] ret_from_fork+0x3d4/0x480 <4> [216.220515] ? __pfx_kthread+0x10/0x10 <4> [216.220519] ret_from_fork_asm+0x1a/0x30 <4> [216.220526] </TASK> <4> [216.220527] irq event stamp: 781867 <4> [216.220528] hardirqs last enabled at (781873): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.220531] hardirqs last disabled at (781878): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.220533] softirqs last enabled at (780918): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.220535] softirqs last disabled at (780911): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.220538] ---[ end trace 0000000000000000 ]--- <6> [216.220539] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.220610] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.220615] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.221892] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.221996] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.222102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.222305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.222397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.222493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.222581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.222666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.222750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.222870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.222957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.223038] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.223134] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.223254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.224262] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.234960] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.235208] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.236203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.236284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.236361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.236438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.236513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.236588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.236662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.236736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.236820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.236896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.236973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.237049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.237124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.237198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.237272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.237346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.237420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.237494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.237566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.237647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.237727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.237833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.237916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.237994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.238071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.238148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.238224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.238302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.238380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.238456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.238534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.238611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.238694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.238781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.238865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.238947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.239031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.239110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.239188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.239265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.239343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.239420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.239497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.239571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.239655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.239734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.239828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.239907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.239985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.240060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.240135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.240213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.240290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.240366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.240442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.240520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.240599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.240678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.240758] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.240883] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.240887] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65893, lrc_seqno=65893, guc_id=0, flags=0x73 in no process [-1] <7> [216.240890] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.240947] ------------[ cut here ]------------ <4> [216.240948] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.240950] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [216.241021] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.241084] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.241088] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.241091] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.241093] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.241094] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.241099] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.241168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.241170] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.241172] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.241173] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.241175] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.241176] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.241177] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.241178] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [216.241180] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.241182] CR2: 00007b785fbe0000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.241183] PKRU: 55555554 <4> [216.241184] Call Trace: <4> [216.241185] <TASK> <4> [216.241189] ? lock_sync+0x100/0x100 <4> [216.241193] ? lock_release+0xd0/0x2b0 <4> [216.241199] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.241205] process_one_work+0x239/0x760 <4> [216.241211] worker_thread+0x200/0x3f0 <4> [216.241214] ? __pfx_worker_thread+0x10/0x10 <4> [216.241216] kthread+0x10d/0x150 <4> [216.241219] ? __pfx_kthread+0x10/0x10 <4> [216.241222] ret_from_fork+0x3d4/0x480 <4> [216.241224] ? __pfx_kthread+0x10/0x10 <4> [216.241228] ret_from_fork_asm+0x1a/0x30 <4> [216.241235] </TASK> <4> [216.241236] irq event stamp: 1075101 <4> [216.241237] hardirqs last enabled at (1075107): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.241240] hardirqs last disabled at (1075112): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.241242] softirqs last enabled at (1074174): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.241245] softirqs last disabled at (1074167): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.241247] ---[ end trace 0000000000000000 ]--- <5> [216.241843] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65948, lrc_seqno=65948, guc_id=0, flags=0x73 in no process [-1] <7> [216.241846] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.241905] ------------[ cut here ]------------ <4> [216.241906] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.241907] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:286/6318 <4> [216.241978] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.242039] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.242043] CPU: 2 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.242046] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.242047] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.242048] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.242053] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.242121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.242123] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.242125] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.242126] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.242127] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.242129] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.242130] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.242131] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [216.242132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.242134] CR2: 00007b785fbe0000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.242135] PKRU: 55555554 <4> [216.242136] Call Trace: <4> [216.242137] <TASK> <4> [216.242141] ? lock_sync+0x100/0x100 <4> [216.242145] ? lock_release+0xd0/0x2b0 <4> [216.242150] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.242156] process_one_work+0x239/0x760 <4> [216.242162] worker_thread+0x200/0x3f0 <4> [216.242164] ? __pfx_worker_thread+0x10/0x10 <4> [216.242166] kthread+0x10d/0x150 <4> [216.242169] ? __pfx_kthread+0x10/0x10 <4> [216.242173] ret_from_fork+0x3d4/0x480 <4> [216.242175] ? __pfx_kthread+0x10/0x10 <4> [216.242178] ret_from_fork_asm+0x1a/0x30 <4> [216.242185] </TASK> <4> [216.242186] irq event stamp: 1077745 <4> [216.242187] hardirqs last enabled at (1077751): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.242190] hardirqs last disabled at (1077756): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.242192] softirqs last enabled at (1076750): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.242194] softirqs last disabled at (1076739): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.242197] ---[ end trace 0000000000000000 ]--- <6> [216.242198] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.242267] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.242273] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.243171] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.243274] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.243379] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.243585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.243676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.243772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.243882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.243969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.244055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.244142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.244229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.244310] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.244405] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.244522] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.245556] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.255786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.256039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.257016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.257094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.257171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.257248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.257324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.257402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.257478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.257553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.257629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.257704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.257786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.257875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.257952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.258029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.258104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.258178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.258252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.258326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.258398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.258480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.258560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.258639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.258718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.258804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.258887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.258965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.259041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.259121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.259200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.259278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.259357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.259437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.259521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.259606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.259689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.259772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.259874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.259953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.260030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.260107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.260189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.260266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.260349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.260429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.260513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.260594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.260671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.260751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.260842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.260920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.260996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.261075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.261151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.261229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.261307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.261386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.261462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.261537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.261615] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.261727] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.261731] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65948, lrc_seqno=65948, guc_id=0, flags=0x73 in no process [-1] <7> [216.261734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.261827] ------------[ cut here ]------------ <4> [216.261828] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.261830] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.261901] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.261969] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.261973] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.261976] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.261977] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.261979] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.261984] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.262052] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.262054] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.262056] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.262058] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.262059] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.262060] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.262061] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.262063] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.262064] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.262066] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.262067] PKRU: 55555554 <4> [216.262068] Call Trace: <4> [216.262070] <TASK> <4> [216.262073] ? lock_sync+0x100/0x100 <4> [216.262078] ? lock_release+0xd0/0x2b0 <4> [216.262083] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.262089] process_one_work+0x239/0x760 <4> [216.262096] worker_thread+0x200/0x3f0 <4> [216.262098] ? __pfx_worker_thread+0x10/0x10 <4> [216.262101] kthread+0x10d/0x150 <4> [216.262104] ? __pfx_kthread+0x10/0x10 <4> [216.262107] ret_from_fork+0x3d4/0x480 <4> [216.262109] ? __pfx_kthread+0x10/0x10 <4> [216.262112] ret_from_fork_asm+0x1a/0x30 <4> [216.262120] </TASK> <4> [216.262121] irq event stamp: 1725455 <4> [216.262122] hardirqs last enabled at (1725461): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.262125] hardirqs last disabled at (1725466): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.262127] softirqs last enabled at (1724454): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.262130] softirqs last disabled at (1724447): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.262132] ---[ end trace 0000000000000000 ]--- <6> [216.262134] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.262204] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.262211] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.263455] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.263557] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.263661] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.263875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.263967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.264061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.264149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.264236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.264321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.264407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.264497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.264582] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.264678] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.264796] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.265806] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.276529] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.276771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.277815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.277900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.277970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.278040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.278108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.278176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.278244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.278311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.278377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.278444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.278510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.278576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.278643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.278710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.278782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.278859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.278935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.279010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.279085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.279167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.279248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.279328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.279408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.279486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.279564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.279642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.279719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.279802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.279883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.279965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.280049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.280131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.280219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.280309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.280397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.280479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.280559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.280636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.280713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.280790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.280869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.280946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.281021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.281097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.281179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.281259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.281337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.281414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.281492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.281567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.281642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.281719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.281797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.281875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.281952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.282033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.282110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.282187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.282267] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.282380] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.282384] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=65948, lrc_seqno=65948, guc_id=0, flags=0x73 in no process [-1] <7> [216.282387] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.282445] ------------[ cut here ]------------ <4> [216.282446] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.282448] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [216.282520] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.282585] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.282590] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.282593] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.282594] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.282596] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.282601] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.282672] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.282674] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.282676] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.282677] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.282678] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.282680] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.282681] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.282682] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [216.282684] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.282685] CR2: 00007b785fbe9000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.282687] PKRU: 55555554 <4> [216.282688] Call Trace: <4> [216.282689] <TASK> <4> [216.282693] ? lock_sync+0x100/0x100 <4> [216.282698] ? lock_release+0xd0/0x2b0 <4> [216.282703] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.282709] process_one_work+0x239/0x760 <4> [216.282715] worker_thread+0x200/0x3f0 <4> [216.282718] ? __pfx_worker_thread+0x10/0x10 <4> [216.282720] kthread+0x10d/0x150 <4> [216.282723] ? __pfx_kthread+0x10/0x10 <4> [216.282727] ret_from_fork+0x3d4/0x480 <4> [216.282729] ? __pfx_kthread+0x10/0x10 <4> [216.282732] ret_from_fork_asm+0x1a/0x30 <4> [216.282739] </TASK> <4> [216.282741] irq event stamp: 785305 <4> [216.282742] hardirqs last enabled at (785311): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.282745] hardirqs last disabled at (785316): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.282747] softirqs last enabled at (784228): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.282749] softirqs last disabled at (784221): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.282751] ---[ end trace 0000000000000000 ]--- <5> [216.284161] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66003, lrc_seqno=66003, guc_id=0, flags=0x73 in no process [-1] <7> [216.284164] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.284226] ------------[ cut here ]------------ <4> [216.284227] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.284228] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [216.284298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.284361] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.284365] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.284368] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.284369] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.284370] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.284375] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.284444] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.284446] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.284448] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.284449] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.284450] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.284451] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.284453] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.284454] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [216.284455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.284457] CR2: 00007b785fbe9000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.284458] PKRU: 55555554 <4> [216.284459] Call Trace: <4> [216.284460] <TASK> <4> [216.284464] ? lock_sync+0x100/0x100 <4> [216.284468] ? lock_release+0xd0/0x2b0 <4> [216.284473] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.284479] process_one_work+0x239/0x760 <4> [216.284485] worker_thread+0x200/0x3f0 <4> [216.284487] ? __pfx_worker_thread+0x10/0x10 <4> [216.284490] kthread+0x10d/0x150 <4> [216.284493] ? __pfx_kthread+0x10/0x10 <4> [216.284496] ret_from_fork+0x3d4/0x480 <4> [216.284498] ? __pfx_kthread+0x10/0x10 <4> [216.284501] ret_from_fork_asm+0x1a/0x30 <4> [216.284508] </TASK> <4> [216.284510] irq event stamp: 787921 <4> [216.284511] hardirqs last enabled at (787927): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.284513] hardirqs last disabled at (787932): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.284515] softirqs last enabled at (785378): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.284518] softirqs last disabled at (785367): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.284520] ---[ end trace 0000000000000000 ]--- <6> [216.284522] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.284603] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.284609] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.284623] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.284727] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.284840] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.285071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.285164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.285258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.285346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.285436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.285526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.285614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.285702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.285788] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.285907] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.286024] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.287033] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.296796] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.297059] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.298110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.298190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.298266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.298343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.298422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.298500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.298576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.298651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.298725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.298811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.298887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.298961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.299035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.299108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.299181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.299255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.299328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.299401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.299474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.299554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.299635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.299714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.299798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.299876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.299953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.300031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.300108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.300188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.300272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.300353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.300433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.300513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.300595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.300678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.300762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.300867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.300946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.301022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.301098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.301172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.301253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.301333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.301412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.301488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.301567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.301646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.301727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.301809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.301887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.301965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.302044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.302125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.302204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.302281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.302358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.302435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.302511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.302586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.302664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.302775] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.302783] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66003, lrc_seqno=66003, guc_id=0, flags=0x73 in no process [-1] <7> [216.302788] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.302846] ------------[ cut here ]------------ <4> [216.302847] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.302849] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.302920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.302982] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.302987] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.302990] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.302991] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.302992] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.302998] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.303069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.303071] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.303073] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.303074] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.303076] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.303077] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.303078] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.303079] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.303081] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.303082] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.303084] PKRU: 55555554 <4> [216.303085] Call Trace: <4> [216.303086] <TASK> <4> [216.303090] ? lock_sync+0x100/0x100 <4> [216.303094] ? lock_release+0xd0/0x2b0 <4> [216.303099] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.303105] process_one_work+0x239/0x760 <4> [216.303111] worker_thread+0x200/0x3f0 <4> [216.303114] ? __pfx_worker_thread+0x10/0x10 <4> [216.303116] kthread+0x10d/0x150 <4> [216.303119] ? __pfx_kthread+0x10/0x10 <4> [216.303123] ret_from_fork+0x3d4/0x480 <4> [216.303125] ? __pfx_kthread+0x10/0x10 <4> [216.303128] ret_from_fork_asm+0x1a/0x30 <4> [216.303135] </TASK> <4> [216.303136] irq event stamp: 1730939 <4> [216.303137] hardirqs last enabled at (1730945): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.303140] hardirqs last disabled at (1730950): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.303143] softirqs last enabled at (1730018): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.303145] softirqs last disabled at (1730011): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.303147] ---[ end trace 0000000000000000 ]--- <6> [216.303149] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.303220] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.303226] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.304471] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.304579] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.304684] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.304883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.304974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.305068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.305156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.305242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.305327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.305412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.305499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.305579] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.305673] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.305819] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.306829] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.316786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.317037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.318044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.318123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.318198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.318274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.318351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.318429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.318505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.318579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.318653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.318726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.318805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.318878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.318951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.319024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.319098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.319174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.319249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.319323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.319396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.319477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.319557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.319636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.319718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.319801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.319879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.319956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.320032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.320110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.320189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.320265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.320343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.320425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.320511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.320595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.320679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.320760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.320851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.320927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.321007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.321087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.321168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.321246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.321324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.321403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.321484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.321561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.321637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.321712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.321790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.321864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.321939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.322018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.322099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.322178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.322256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.322333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.322407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.322482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.322562] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.322673] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.322677] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66003, lrc_seqno=66003, guc_id=0, flags=0x73 in no process [-1] <7> [216.322680] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.322737] ------------[ cut here ]------------ <4> [216.322738] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.322740] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [216.322819] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.322884] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.322888] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.322891] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.322892] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.322894] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.322899] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.322969] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.322970] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.322973] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.322974] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.322975] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.322976] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.322978] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.322979] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [216.322980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.322982] CR2: 00007b785fbe9000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.322983] PKRU: 55555554 <4> [216.322984] Call Trace: <4> [216.322985] <TASK> <4> [216.322989] ? lock_sync+0x100/0x100 <4> [216.322994] ? lock_release+0xd0/0x2b0 <4> [216.322999] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.323005] process_one_work+0x239/0x760 <4> [216.323011] worker_thread+0x200/0x3f0 <4> [216.323014] ? __pfx_worker_thread+0x10/0x10 <4> [216.323016] kthread+0x10d/0x150 <4> [216.323019] ? __pfx_kthread+0x10/0x10 <4> [216.323023] ret_from_fork+0x3d4/0x480 <4> [216.323025] ? __pfx_kthread+0x10/0x10 <4> [216.323028] ret_from_fork_asm+0x1a/0x30 <4> [216.323036] </TASK> <4> [216.323037] irq event stamp: 791455 <4> [216.323038] hardirqs last enabled at (791461): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.323041] hardirqs last disabled at (791466): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.323043] softirqs last enabled at (790540): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.323046] softirqs last disabled at (790533): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.323048] ---[ end trace 0000000000000000 ]--- <7> [216.324564] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.324668] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [216.324766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66058, lrc_seqno=66058, guc_id=0, flags=0x73 in no process [-1] <7> [216.324769] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.324851] ------------[ cut here ]------------ <4> [216.324853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.324854] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [216.324925] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.324988] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.324992] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.324995] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.324996] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.324997] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.325002] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.325072] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.325073] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.325075] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.325077] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.325078] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.325079] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.325080] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.325081] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [216.325083] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.325084] CR2: 00007b785fbe9000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.325086] PKRU: 55555554 <4> [216.325087] Call Trace: <4> [216.325088] <TASK> <4> [216.325092] ? lock_sync+0x100/0x100 <4> [216.325096] ? lock_release+0xd0/0x2b0 <4> [216.325101] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.325107] process_one_work+0x239/0x760 <4> [216.325113] worker_thread+0x200/0x3f0 <4> [216.325115] ? __pfx_worker_thread+0x10/0x10 <4> [216.325118] kthread+0x10d/0x150 <4> [216.325121] ? __pfx_kthread+0x10/0x10 <4> [216.325124] ret_from_fork+0x3d4/0x480 <4> [216.325126] ? __pfx_kthread+0x10/0x10 <4> [216.325130] ret_from_fork_asm+0x1a/0x30 <4> [216.325137] </TASK> <4> [216.325138] irq event stamp: 794157 <4> [216.325139] hardirqs last enabled at (794163): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.325142] hardirqs last disabled at (794168): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.325144] softirqs last enabled at (793390): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.325146] softirqs last disabled at (793379): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.325148] ---[ end trace 0000000000000000 ]--- <6> [216.325150] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.325221] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.325227] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.325276] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.325487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.325579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.325676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.325767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.325903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.325994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.326082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.326173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.326258] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.326355] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.326471] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.327486] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.337788] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.338038] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.339111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.339190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.339268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.339345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.339421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.339496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.339571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.339645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.339719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.339800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.339887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.339965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.340040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.340114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.340189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.340263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.340337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.340411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.340483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.340564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.340645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.340726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.340820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.340912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.340988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.341064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.341142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.341225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.341305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.341382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.341462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.341540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.341623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.341705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.341794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.341884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.341962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.342038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.342114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.342189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.342269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.342349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.342427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.342504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.342585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.342663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.342744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.342835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.342928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.343004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.343080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.343159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.343236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.343313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.343387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.343465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.343544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.343623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.343704] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.343822] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.343828] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66058, lrc_seqno=66058, guc_id=0, flags=0x73 in no process [-1] <7> [216.343830] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.343889] ------------[ cut here ]------------ <4> [216.343890] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.343892] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.343963] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.344027] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.344032] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.344035] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.344036] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.344038] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.344043] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.344112] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.344113] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.344116] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.344117] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.344119] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.344120] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.344121] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.344122] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.344124] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.344125] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.344127] PKRU: 55555554 <4> [216.344128] Call Trace: <4> [216.344129] <TASK> <4> [216.344133] ? lock_sync+0x100/0x100 <4> [216.344138] ? lock_release+0xd0/0x2b0 <4> [216.344143] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.344149] process_one_work+0x239/0x760 <4> [216.344155] worker_thread+0x200/0x3f0 <4> [216.344158] ? __pfx_worker_thread+0x10/0x10 <4> [216.344160] kthread+0x10d/0x150 <4> [216.344163] ? __pfx_kthread+0x10/0x10 <4> [216.344166] ret_from_fork+0x3d4/0x480 <4> [216.344168] ? __pfx_kthread+0x10/0x10 <4> [216.344172] ret_from_fork_asm+0x1a/0x30 <4> [216.344179] </TASK> <4> [216.344180] irq event stamp: 1083269 <4> [216.344181] hardirqs last enabled at (1083275): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.344184] hardirqs last disabled at (1083280): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.344186] softirqs last enabled at (1082250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.344189] softirqs last disabled at (1082243): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.344191] ---[ end trace 0000000000000000 ]--- <6> [216.344193] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.344263] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.344270] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.345524] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.345630] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.345735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.345958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.346049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.346142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.346231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.346317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.346402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.346491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.346579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.346660] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.346755] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.346881] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.347888] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.357787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.358036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.359118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.359196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.359272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.359349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.359424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.359500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.359574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.359650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.359723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.359800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.359874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.359951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.360028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.360104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.360179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.360253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.360325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.360398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.360470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.360551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.360632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.360709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.360791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.360869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.360946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.361022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.361098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.361177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.361256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.361334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.361413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.361493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.361577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.361659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.361741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.361834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.361916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.361998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.362077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.362154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.362235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.362317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.362396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.362474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.362554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.362631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.362708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.362794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.362874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.362950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.363027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.363105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.363182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.363261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.363342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.363421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.363499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.363574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.363653] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.363764] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.363769] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66058, lrc_seqno=66058, guc_id=0, flags=0x73 in no process [-1] <7> [216.363771] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.363850] ------------[ cut here ]------------ <4> [216.363851] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.363853] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.363925] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.363989] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.363994] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.363996] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.363998] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.363999] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.364004] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.364074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.364076] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.364078] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.364079] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.364081] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.364082] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.364083] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.364084] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.364086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.364087] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.364089] PKRU: 55555554 <4> [216.364090] Call Trace: <4> [216.364091] <TASK> <4> [216.364095] ? lock_sync+0x100/0x100 <4> [216.364099] ? lock_release+0xd0/0x2b0 <4> [216.364105] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.364110] process_one_work+0x239/0x760 <4> [216.364116] worker_thread+0x200/0x3f0 <4> [216.364119] ? __pfx_worker_thread+0x10/0x10 <4> [216.364121] kthread+0x10d/0x150 <4> [216.364124] ? __pfx_kthread+0x10/0x10 <4> [216.364128] ret_from_fork+0x3d4/0x480 <4> [216.364130] ? __pfx_kthread+0x10/0x10 <4> [216.364133] ret_from_fork_asm+0x1a/0x30 <4> [216.364140] </TASK> <4> [216.364141] irq event stamp: 1734391 <4> [216.364143] hardirqs last enabled at (1734397): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.364145] hardirqs last disabled at (1734402): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.364148] softirqs last enabled at (1733470): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.364150] softirqs last disabled at (1733463): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.364152] ---[ end trace 0000000000000000 ]--- <5> [216.365605] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66113, lrc_seqno=66113, guc_id=0, flags=0x73 in no process [-1] <7> [216.365608] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.365669] ------------[ cut here ]------------ <4> [216.365670] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.365671] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.365741] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.365807] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.365812] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.365814] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.365815] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.365817] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.365821] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.365889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.365891] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.365893] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.365894] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.365895] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.365896] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.365897] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.365899] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.365900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.365901] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.365903] PKRU: 55555554 <4> [216.365904] Call Trace: <4> [216.365905] <TASK> <4> [216.365909] ? lock_sync+0x100/0x100 <4> [216.365913] ? lock_release+0xd0/0x2b0 <4> [216.365918] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.365923] process_one_work+0x239/0x760 <4> [216.365929] worker_thread+0x200/0x3f0 <4> [216.365932] ? __pfx_worker_thread+0x10/0x10 <4> [216.365934] kthread+0x10d/0x150 <4> [216.365937] ? __pfx_kthread+0x10/0x10 <4> [216.365941] ret_from_fork+0x3d4/0x480 <4> [216.365943] ? __pfx_kthread+0x10/0x10 <4> [216.365946] ret_from_fork_asm+0x1a/0x30 <4> [216.365953] </TASK> <4> [216.365954] irq event stamp: 1737097 <4> [216.365955] hardirqs last enabled at (1737103): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.365958] hardirqs last disabled at (1737108): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.365960] softirqs last enabled at (1733470): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.365962] softirqs last disabled at (1733463): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.365964] ---[ end trace 0000000000000000 ]--- <7> [216.365977] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.366080] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [216.366178] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.366248] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.366254] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.366302] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.366508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.366600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.366693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.366783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.366870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.366955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.367040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.367126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.367208] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.367303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.367421] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.368427] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.378785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.379035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.380103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.380182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.380256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.380326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.380397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.380465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.380534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.380600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.380668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.380736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.380811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.380885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.380961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.381036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.381111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.381186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.381260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.381333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.381406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.381487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.381567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.381649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.381730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.381816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.381893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.381968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.382043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.382121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.382200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.382277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.382355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.382432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.382515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.382597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.382685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.382768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.382862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.382945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.383025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.383103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.383183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.383261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.383338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.383414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.383498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.383577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.383656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.383732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.383816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.383891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.383966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.384046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.384125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.384204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.384281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.384359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.384434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.384509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.384588] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.384698] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.384702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66113, lrc_seqno=66113, guc_id=0, flags=0x73 in no process [-1] <7> [216.384705] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.384764] ------------[ cut here ]------------ <4> [216.384765] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.384766] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:142/6174 <4> [216.384853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.384917] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.384921] CPU: 9 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.384924] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.384925] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.384926] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.384931] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.385001] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.385003] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.385005] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.385006] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.385008] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.385009] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.385010] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.385011] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [216.385013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.385014] CR2: 00007b785fbe9000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.385016] PKRU: 55555554 <4> [216.385017] Call Trace: <4> [216.385018] <TASK> <4> [216.385022] ? lock_sync+0x100/0x100 <4> [216.385026] ? lock_release+0xd0/0x2b0 <4> [216.385032] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.385037] process_one_work+0x239/0x760 <4> [216.385044] worker_thread+0x200/0x3f0 <4> [216.385046] ? __pfx_worker_thread+0x10/0x10 <4> [216.385049] kthread+0x10d/0x150 <4> [216.385051] ? __pfx_kthread+0x10/0x10 <4> [216.385055] ret_from_fork+0x3d4/0x480 <4> [216.385057] ? __pfx_kthread+0x10/0x10 <4> [216.385060] ret_from_fork_asm+0x1a/0x30 <4> [216.385068] </TASK> <4> [216.385069] irq event stamp: 799643 <4> [216.385070] hardirqs last enabled at (799649): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.385073] hardirqs last disabled at (799654): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.385075] softirqs last enabled at (798894): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.385077] softirqs last disabled at (798877): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.385079] ---[ end trace 0000000000000000 ]--- <6> [216.385917] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.386073] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.386086] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.386097] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.386202] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.386310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.386564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.386711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.386861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.386996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.387128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.387259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.387391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.387525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.387656] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.387817] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.387983] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.389326] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.399788] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.400097] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.401316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.401437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.401554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.401673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.401808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.401898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.401979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.402056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.402133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.402209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.402286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.402362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.402437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.402511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.402584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.402657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.402729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.402818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.402890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.402971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.403052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.403132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.403212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.403291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.403372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.403453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.403530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.403608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.403687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.403765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.403855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.403935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.404018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.404102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.404189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.404272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.404354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.404432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.404509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.404584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.404662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.404738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.404853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.404982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.405078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.405160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.405242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.405320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.405399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.405475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.405551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.405630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.405707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.405790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.405885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.405968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.406045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.406120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.406199] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.406312] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.406318] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66113, lrc_seqno=66113, guc_id=0, flags=0x73 in no process [-1] <7> [216.406321] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.406380] ------------[ cut here ]------------ <4> [216.406381] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.406382] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:142/6174 <4> [216.406454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.406517] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.406522] CPU: 0 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.406525] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.406526] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.406527] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.406532] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.406603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.406604] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.406606] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.406608] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.406609] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.406610] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.406612] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.406613] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.406614] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.406616] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.406617] PKRU: 55555554 <4> [216.406618] Call Trace: <4> [216.406619] <TASK> <4> [216.406623] ? lock_sync+0x100/0x100 <4> [216.406628] ? lock_release+0xd0/0x2b0 <4> [216.406633] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.406638] process_one_work+0x239/0x760 <4> [216.406645] worker_thread+0x200/0x3f0 <4> [216.406647] ? __pfx_worker_thread+0x10/0x10 <4> [216.406650] kthread+0x10d/0x150 <4> [216.406653] ? __pfx_kthread+0x10/0x10 <4> [216.406656] ret_from_fork+0x3d4/0x480 <4> [216.406658] ? __pfx_kthread+0x10/0x10 <4> [216.406662] ret_from_fork_asm+0x1a/0x30 <4> [216.406669] </TASK> <4> [216.406670] irq event stamp: 802861 <4> [216.406671] hardirqs last enabled at (802867): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.406674] hardirqs last disabled at (802872): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.406676] softirqs last enabled at (801798): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.406679] softirqs last disabled at (801791): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.406681] ---[ end trace 0000000000000000 ]--- <7> [216.408566] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.408672] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [216.408770] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66168, lrc_seqno=66168, guc_id=0, flags=0x73 in no process [-1] <7> [216.408773] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.408857] ------------[ cut here ]------------ <4> [216.408858] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.408859] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.408949] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.409012] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.409016] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.409019] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.409020] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.409022] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.409027] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.409098] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.409100] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.409102] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.409103] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.409104] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.409106] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.409107] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.409108] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.409110] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.409111] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.409113] PKRU: 55555554 <4> [216.409114] Call Trace: <4> [216.409115] <TASK> <4> [216.409118] ? lock_sync+0x100/0x100 <4> [216.409123] ? lock_release+0xd0/0x2b0 <4> [216.409128] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.409134] process_one_work+0x239/0x760 <4> [216.409140] worker_thread+0x200/0x3f0 <4> [216.409142] ? __pfx_worker_thread+0x10/0x10 <4> [216.409145] kthread+0x10d/0x150 <4> [216.409148] ? __pfx_kthread+0x10/0x10 <4> [216.409151] ret_from_fork+0x3d4/0x480 <4> [216.409153] ? __pfx_kthread+0x10/0x10 <4> [216.409157] ret_from_fork_asm+0x1a/0x30 <4> [216.409164] </TASK> <4> [216.409165] irq event stamp: 1740313 <4> [216.409166] hardirqs last enabled at (1740319): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.409169] hardirqs last disabled at (1740324): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.409171] softirqs last enabled at (1739546): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.409174] softirqs last disabled at (1739541): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.409176] ---[ end trace 0000000000000000 ]--- <6> [216.409178] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.409247] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.409255] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.409481] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.409685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.409773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.409883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.410006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.410094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.410183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.410271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.410359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.410443] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.410538] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.410657] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.411671] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.421788] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.422045] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.423091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.423164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.423234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.423306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.423378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.423447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.423517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.423584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.423650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.423717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.423789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.423863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.423945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.424012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.424078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.424145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.424212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.424278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.424347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.424422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.424498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.424570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.424642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.424713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.424789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.424885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.424960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.425034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.425109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.425180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.425252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.425324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.425401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.425478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.425554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.425627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.425703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.425776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.425864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.425949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.426022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.426091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.426161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.426231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.426304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.426373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.426442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.426513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.426586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.426656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.426726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.426803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.426895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.426965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.427037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.427110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.427179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.427247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.427318] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.427427] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.427431] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66168, lrc_seqno=66168, guc_id=0, flags=0x73 in no process [-1] <7> [216.427433] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.427487] ------------[ cut here ]------------ <4> [216.427488] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.427490] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.427555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.427613] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.427617] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.427620] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.427621] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.427622] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.427627] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.427689] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.427691] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.427693] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.427694] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.427695] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.427696] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.427697] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.427699] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.427700] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.427701] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.427703] PKRU: 55555554 <4> [216.427704] Call Trace: <4> [216.427705] <TASK> <4> [216.427708] ? lock_sync+0x100/0x100 <4> [216.427712] ? lock_release+0xd0/0x2b0 <4> [216.427717] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.427722] process_one_work+0x239/0x760 <4> [216.427728] worker_thread+0x200/0x3f0 <4> [216.427730] ? __pfx_worker_thread+0x10/0x10 <4> [216.427732] kthread+0x10d/0x150 <4> [216.427735] ? __pfx_kthread+0x10/0x10 <4> [216.427738] ret_from_fork+0x3d4/0x480 <4> [216.427740] ? __pfx_kthread+0x10/0x10 <4> [216.427743] ret_from_fork_asm+0x1a/0x30 <4> [216.427749] </TASK> <4> [216.427750] irq event stamp: 1743421 <4> [216.427751] hardirqs last enabled at (1743427): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.427754] hardirqs last disabled at (1743432): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.427756] softirqs last enabled at (1742438): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.427758] softirqs last disabled at (1742431): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.427760] ---[ end trace 0000000000000000 ]--- <6> [216.427762] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.428775] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.428785] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.428861] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.428956] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.429053] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.429250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.429331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.429416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.429497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.429576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.429653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.429732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.429822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.429919] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.430006] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.430115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.431119] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.441786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.442030] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.443064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.443136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.443206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.443276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.443344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.443412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.443479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.443546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.443614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.443680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.443747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.443883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.443956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.444028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.444098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.444166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.444233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.444300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.444367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.444441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.444514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.444587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.444662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.444732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.444835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.444923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.444993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.445065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.445137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.445209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.445281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.445352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.445431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.445509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.445587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.445661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.445733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.445812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.445896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.445965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.446037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.446107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.446177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.446249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.446323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.446393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.446464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.446534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.446604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.446672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.446740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.446820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.446915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.446988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.447059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.447132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.447201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.447269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.447340] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.447446] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.447450] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66168, lrc_seqno=66168, guc_id=0, flags=0x73 in no process [-1] <7> [216.447452] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.447506] ------------[ cut here ]------------ <4> [216.447507] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.447508] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.447573] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.447631] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.447635] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.447638] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.447639] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.447640] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.447645] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.447708] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.447710] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.447712] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.447713] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.447714] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.447715] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.447716] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.447718] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.447719] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.447720] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.447722] PKRU: 55555554 <4> [216.447723] Call Trace: <4> [216.447724] <TASK> <4> [216.447727] ? lock_sync+0x100/0x100 <4> [216.447731] ? lock_release+0xd0/0x2b0 <4> [216.447736] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.447741] process_one_work+0x239/0x760 <4> [216.447747] worker_thread+0x200/0x3f0 <4> [216.447749] ? __pfx_worker_thread+0x10/0x10 <4> [216.447751] kthread+0x10d/0x150 <4> [216.447754] ? __pfx_kthread+0x10/0x10 <4> [216.447757] ret_from_fork+0x3d4/0x480 <4> [216.447759] ? __pfx_kthread+0x10/0x10 <4> [216.447762] ret_from_fork_asm+0x1a/0x30 <4> [216.447769] </TASK> <4> [216.447770] irq event stamp: 1746881 <4> [216.447771] hardirqs last enabled at (1746887): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.447773] hardirqs last disabled at (1746892): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.447775] softirqs last enabled at (1745782): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.447782] softirqs last disabled at (1745749): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.447785] ---[ end trace 0000000000000000 ]--- <7> [216.449507] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.449611] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [216.449709] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66223, lrc_seqno=66223, guc_id=0, flags=0x73 in no process [-1] <7> [216.449712] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.449770] ------------[ cut here ]------------ <4> [216.449771] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.449772] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.449865] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.449963] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.449967] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.449970] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.449971] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.449973] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.449977] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.450049] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.450051] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.450053] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.450055] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.450056] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.450057] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.450058] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.450060] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.450061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.450062] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.450064] PKRU: 55555554 <4> [216.450065] Call Trace: <4> [216.450066] <TASK> <4> [216.450070] ? lock_sync+0x100/0x100 <4> [216.450074] ? lock_release+0xd0/0x2b0 <4> [216.450079] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.450085] process_one_work+0x239/0x760 <4> [216.450091] worker_thread+0x200/0x3f0 <4> [216.450093] ? __pfx_worker_thread+0x10/0x10 <4> [216.450096] kthread+0x10d/0x150 <4> [216.450098] ? __pfx_kthread+0x10/0x10 <4> [216.450102] ret_from_fork+0x3d4/0x480 <4> [216.450104] ? __pfx_kthread+0x10/0x10 <4> [216.450107] ret_from_fork_asm+0x1a/0x30 <4> [216.450114] </TASK> <4> [216.450115] irq event stamp: 1749737 <4> [216.450117] hardirqs last enabled at (1749743): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.450119] hardirqs last disabled at (1749748): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.450122] softirqs last enabled at (1748988): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.450124] softirqs last disabled at (1748977): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.450126] ---[ end trace 0000000000000000 ]--- <6> [216.450128] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.450198] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.450205] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.450254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.450457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.450546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.450639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.450728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.450828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.450950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.451038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.451126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.451209] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.451303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.451421] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.452431] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.462786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.463034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.464039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.464112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.464182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.464252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.464321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.464389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.464457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.464526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.464595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.464664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.464733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.464809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.464897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.464965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.465031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.465098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.465164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.465230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.465296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.465369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.465441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.465512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.465585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.465657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.465727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.465814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.465909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.465982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.466054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.466129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.466204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.466278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.466356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.466432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.466508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.466582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.466655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.466728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.466811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.466910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.466983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.467058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.467133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.467206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.467282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.467357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.467430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.467501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.467572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.467641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.467709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.467788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.467882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.467952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.468021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.468093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.468162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.468231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.468306] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.468415] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.468419] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66223, lrc_seqno=66223, guc_id=0, flags=0x73 in no process [-1] <7> [216.468421] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.468475] ------------[ cut here ]------------ <4> [216.468476] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.468477] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.468543] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.468601] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.468605] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.468608] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.468609] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.468610] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.468615] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.468678] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.468680] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.468682] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.468683] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.468684] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.468685] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.468686] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.468688] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.468689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.468690] CR2: 00007aa4503ff000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.468692] PKRU: 55555554 <4> [216.468693] Call Trace: <4> [216.468694] <TASK> <4> [216.468697] ? lock_sync+0x100/0x100 <4> [216.468701] ? lock_release+0xd0/0x2b0 <4> [216.468706] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.468711] process_one_work+0x239/0x760 <4> [216.468717] worker_thread+0x200/0x3f0 <4> [216.468719] ? __pfx_worker_thread+0x10/0x10 <4> [216.468721] kthread+0x10d/0x150 <4> [216.468724] ? __pfx_kthread+0x10/0x10 <4> [216.468727] ret_from_fork+0x3d4/0x480 <4> [216.468729] ? __pfx_kthread+0x10/0x10 <4> [216.468732] ret_from_fork_asm+0x1a/0x30 <4> [216.468739] </TASK> <4> [216.468740] irq event stamp: 1752847 <4> [216.468741] hardirqs last enabled at (1752853): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.468743] hardirqs last disabled at (1752858): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.468745] softirqs last enabled at (1751952): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.468748] softirqs last disabled at (1751945): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.468750] ---[ end trace 0000000000000000 ]--- <6> [216.468751] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.469769] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.469776] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.469857] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.469954] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.470052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.470249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.470333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.470431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.470513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.470593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.470673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.470756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.470882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.470959] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.471046] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.471154] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.472154] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.482786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.483028] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.484007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.484081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.484152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.484221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.484290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.484359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.484427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.484495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.484563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.484633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.484704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.484773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.484871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.484939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.485006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.485072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.485139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.485206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.485275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.485351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.485426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.485499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.485571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.485640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.485709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.485784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.485858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.485933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.486006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.486078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.486149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.486220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.486298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.486373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.486447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.486519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.486591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.486665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.486737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.486817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.486890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.486960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.487030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.487099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.487173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.487245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.487317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.487387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.487458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.487528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.487596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.487668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.487738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.487817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.487890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.487963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.488033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.488103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.488175] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.488283] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.488287] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66223, lrc_seqno=66223, guc_id=0, flags=0x73 in no process [-1] <7> [216.488289] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.488344] ------------[ cut here ]------------ <4> [216.488345] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.488346] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:142/6174 <4> [216.488410] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.488469] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.488474] CPU: 1 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.488476] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.488477] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.488479] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.488483] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.488547] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.488548] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.488550] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.488551] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.488553] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.488554] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.488555] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.488556] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [216.488557] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.488559] CR2: 00007b7854098268 CR3: 000000013970b004 CR4: 0000000000f72ef0 <4> [216.488560] PKRU: 55555554 <4> [216.488561] Call Trace: <4> [216.488562] <TASK> <4> [216.488565] ? lock_sync+0x100/0x100 <4> [216.488570] ? lock_release+0xd0/0x2b0 <4> [216.488574] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.488580] process_one_work+0x239/0x760 <4> [216.488585] worker_thread+0x200/0x3f0 <4> [216.488588] ? __pfx_worker_thread+0x10/0x10 <4> [216.488590] kthread+0x10d/0x150 <4> [216.488593] ? __pfx_kthread+0x10/0x10 <4> [216.488596] ret_from_fork+0x3d4/0x480 <4> [216.488598] ? __pfx_kthread+0x10/0x10 <4> [216.488601] ret_from_fork_asm+0x1a/0x30 <4> [216.488607] </TASK> <4> [216.488608] irq event stamp: 810609 <4> [216.488609] hardirqs last enabled at (810615): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.488612] hardirqs last disabled at (810620): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.488614] softirqs last enabled at (809730): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.488616] softirqs last disabled at (809719): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.488618] ---[ end trace 0000000000000000 ]--- <5> [216.490133] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66278, lrc_seqno=66278, guc_id=0, flags=0x73 in no process [-1] <7> [216.490136] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.490198] ------------[ cut here ]------------ <4> [216.490199] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.490201] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:142/6174 <4> [216.490272] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.490334] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.490339] CPU: 1 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.490341] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.490343] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.490344] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.490348] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.490417] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.490419] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.490421] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.490422] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.490424] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.490425] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.490426] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.490427] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [216.490429] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.490430] CR2: 00007b7854098268 CR3: 000000013970b004 CR4: 0000000000f72ef0 <4> [216.490431] PKRU: 55555554 <4> [216.490433] Call Trace: <4> [216.490434] <TASK> <4> [216.490437] ? lock_sync+0x100/0x100 <4> [216.490441] ? lock_release+0xd0/0x2b0 <4> [216.490446] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.490452] process_one_work+0x239/0x760 <4> [216.490457] worker_thread+0x200/0x3f0 <4> [216.490460] ? __pfx_worker_thread+0x10/0x10 <4> [216.490462] kthread+0x10d/0x150 <4> [216.490465] ? __pfx_kthread+0x10/0x10 <4> [216.490469] ret_from_fork+0x3d4/0x480 <4> [216.490471] ? __pfx_kthread+0x10/0x10 <4> [216.490474] ret_from_fork_asm+0x1a/0x30 <4> [216.490481] </TASK> <4> [216.490482] irq event stamp: 813309 <4> [216.490483] hardirqs last enabled at (813315): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.490486] hardirqs last disabled at (813320): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.490488] softirqs last enabled at (809730): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.490490] softirqs last disabled at (809719): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.490493] ---[ end trace 0000000000000000 ]--- <6> [216.490494] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.490563] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.490570] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.490583] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.490687] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.490797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.491026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.491118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.491213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.491304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.491395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.491483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.491571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.491657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.491740] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.491852] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.491978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.492985] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.502787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.503036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.504073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.504151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.504221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.504290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.504358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.504426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.504494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.504561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.504628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.504698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.504768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.504859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.504937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.505005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.505074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.505141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.505207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.505274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.505341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.505414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.505489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.505561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.505632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.505701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.505769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.505858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.505939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.506010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.506084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.506157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.506229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.506301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.506379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.506456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.506533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.506607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.506679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.506749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.506834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.506922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.506998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.507071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.507141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.507210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.507283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.507352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.507423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.507491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.507563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.507635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.507706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.507784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.507874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.507944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.508014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.508084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.508153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.508221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.508292] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.508400] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.508404] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66278, lrc_seqno=66278, guc_id=0, flags=0x73 in no process [-1] <7> [216.508406] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.508458] ------------[ cut here ]------------ <4> [216.508459] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.508461] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.508526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.508583] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.508588] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.508590] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.508591] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.508593] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.508597] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.508661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.508662] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.508664] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.508666] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.508667] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.508668] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.508669] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.508670] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.508672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.508673] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.508674] PKRU: 55555554 <4> [216.508675] Call Trace: <4> [216.508676] <TASK> <4> [216.508680] ? lock_sync+0x100/0x100 <4> [216.508684] ? lock_release+0xd0/0x2b0 <4> [216.508689] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.508694] process_one_work+0x239/0x760 <4> [216.508699] worker_thread+0x200/0x3f0 <4> [216.508702] ? __pfx_worker_thread+0x10/0x10 <4> [216.508704] kthread+0x10d/0x150 <4> [216.508707] ? __pfx_kthread+0x10/0x10 <4> [216.508710] ret_from_fork+0x3d4/0x480 <4> [216.508712] ? __pfx_kthread+0x10/0x10 <4> [216.508715] ret_from_fork_asm+0x1a/0x30 <4> [216.508721] </TASK> <4> [216.508722] irq event stamp: 1089697 <4> [216.508723] hardirqs last enabled at (1089703): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.508726] hardirqs last disabled at (1089708): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.508728] softirqs last enabled at (1088608): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.508730] softirqs last disabled at (1088599): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.508732] ---[ end trace 0000000000000000 ]--- <6> [216.508734] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.508813] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.508822] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.509232] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.509428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.509509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.509596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.509676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.509754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.509848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.509934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.510014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.510091] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.510178] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.510290] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.511291] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.522006] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.522250] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.523299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.523371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.523440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.523511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.523581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.523650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.523722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.523800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.523882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.523957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.524031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.524105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.524179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.524253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.524327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.524403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.524479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.524553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.524628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.524709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.524797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.524880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.524960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.525037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.525114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.525192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.525268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.525350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.525434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.525513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.525592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.525671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.525755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.525849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.525934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.526015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.526094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.526171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.526250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.526329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.526410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.526488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.526565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.526641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.526720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.526800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.526876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.526953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.527033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.527108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.527184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.527262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.527338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.527414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.527489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.527565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.527639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.527713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.527796] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.527907] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.527911] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66278, lrc_seqno=66278, guc_id=0, flags=0x73 in no process [-1] <7> [216.527913] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.527971] ------------[ cut here ]------------ <4> [216.527972] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.527974] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.528045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.528107] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.528112] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.528115] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.528116] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.528117] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.528122] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.528192] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.528194] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.528196] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.528198] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.528199] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.528200] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.528201] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.528203] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.528204] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.528205] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.528207] PKRU: 55555554 <4> [216.528208] Call Trace: <4> [216.528209] <TASK> <4> [216.528213] ? lock_sync+0x100/0x100 <4> [216.528217] ? lock_release+0xd0/0x2b0 <4> [216.528223] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.528228] process_one_work+0x239/0x760 <4> [216.528234] worker_thread+0x200/0x3f0 <4> [216.528237] ? __pfx_worker_thread+0x10/0x10 <4> [216.528239] kthread+0x10d/0x150 <4> [216.528242] ? __pfx_kthread+0x10/0x10 <4> [216.528246] ret_from_fork+0x3d4/0x480 <4> [216.528248] ? __pfx_kthread+0x10/0x10 <4> [216.528251] ret_from_fork_asm+0x1a/0x30 <4> [216.528258] </TASK> <4> [216.528259] irq event stamp: 1092829 <4> [216.528261] hardirqs last enabled at (1092835): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.528263] hardirqs last disabled at (1092840): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.528266] softirqs last enabled at (1091800): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.528268] softirqs last disabled at (1091791): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.528270] ---[ end trace 0000000000000000 ]--- <5> [216.529754] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66333, lrc_seqno=66333, guc_id=0, flags=0x73 in no process [-1] <7> [216.529757] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.529843] ------------[ cut here ]------------ <4> [216.529844] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.529846] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.529915] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.529978] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.529982] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.529985] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.529986] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.529987] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.529991] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.530060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.530062] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.530064] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.530066] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.530067] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.530068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.530069] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.530070] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.530072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.530073] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.530075] PKRU: 55555554 <4> [216.530076] Call Trace: <4> [216.530077] <TASK> <4> [216.530080] ? lock_sync+0x100/0x100 <4> [216.530085] ? lock_release+0xd0/0x2b0 <4> [216.530090] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.530095] process_one_work+0x239/0x760 <4> [216.530101] worker_thread+0x200/0x3f0 <4> [216.530104] ? __pfx_worker_thread+0x10/0x10 <4> [216.530106] kthread+0x10d/0x150 <4> [216.530109] ? __pfx_kthread+0x10/0x10 <4> [216.530113] ret_from_fork+0x3d4/0x480 <4> [216.530115] ? __pfx_kthread+0x10/0x10 <4> [216.530118] ret_from_fork_asm+0x1a/0x30 <4> [216.530125] </TASK> <4> [216.530126] irq event stamp: 1095201 <4> [216.530127] hardirqs last enabled at (1095207): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.530130] hardirqs last disabled at (1095212): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.530132] softirqs last enabled at (1094434): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.530134] softirqs last disabled at (1094425): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.530137] ---[ end trace 0000000000000000 ]--- <6> [216.530138] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.530207] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.530213] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.530226] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.530329] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.530434] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.530643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.530735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.530844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.530933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.531020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.531104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.531189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.531276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.531358] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.531453] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.531569] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.532580] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.542787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.543039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.544121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.544200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.544277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.544354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.544429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.544503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.544577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.544652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.544725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.544807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.544881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.544955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.545031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.545106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.545180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.545253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.545326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.545398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.545471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.545551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.545632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.545713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.545797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.545875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.545952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.546029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.546104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.546182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.546260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.546337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.546413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.546489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.546572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.546653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.546735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.546826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.546909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.546990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.547068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.547145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.547224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.547301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.547378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.547455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.547536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.547611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.547687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.547764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.547894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.547970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.548046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.548128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.548205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.548285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.548361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.548439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.548514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.548589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.548668] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.549648] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.549653] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66333, lrc_seqno=66333, guc_id=0, flags=0x73 in no process [-1] <7> [216.549656] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.549719] ------------[ cut here ]------------ <4> [216.549721] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.549724] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.549807] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.549873] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.549878] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.549881] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.549882] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.549884] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.549889] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.549959] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.549961] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.549963] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.549965] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.549966] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.549967] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.549969] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.549970] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.549972] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.549973] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.549975] PKRU: 55555554 <4> [216.549976] Call Trace: <4> [216.549977] <TASK> <4> [216.549981] ? lock_sync+0x100/0x100 <4> [216.549985] ? lock_release+0xd0/0x2b0 <4> [216.549991] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.549996] process_one_work+0x239/0x760 <4> [216.550003] worker_thread+0x200/0x3f0 <4> [216.550006] ? __pfx_worker_thread+0x10/0x10 <4> [216.550008] kthread+0x10d/0x150 <4> [216.550011] ? __pfx_kthread+0x10/0x10 <4> [216.550015] ret_from_fork+0x3d4/0x480 <4> [216.550017] ? __pfx_kthread+0x10/0x10 <4> [216.550020] ret_from_fork_asm+0x1a/0x30 <4> [216.550027] </TASK> <4> [216.550028] irq event stamp: 1758927 <4> [216.550029] hardirqs last enabled at (1758933): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.550032] hardirqs last disabled at (1758938): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.550034] softirqs last enabled at (1758122): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.550037] softirqs last disabled at (1758091): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.550039] ---[ end trace 0000000000000000 ]--- <7> [216.550052] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.550168] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [216.550267] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.550337] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.550344] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.550754] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.550970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.551060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.551154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.551244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.551332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.551417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.551503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.551588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.551670] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.551765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.551903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.552929] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.562790] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.563038] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.564077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.564155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.564232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.564310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.564387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.564463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.564545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.564624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.564699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.564774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.564867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.564941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.565014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.565088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.565164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.565239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.565315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.565391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.565466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.565548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.565629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.565708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.565792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.565869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.565950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.566029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.566106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.566186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.566265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.566342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.566420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.566498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.566582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.566666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.566753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.566876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.566991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.567104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.567220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.567327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.567410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.567489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.567568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.567645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.567725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.567811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.567889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.567964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.568046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.568126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.568204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.568284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.568361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.568439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.568518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.568600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.568677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.568754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.568846] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.568961] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.568965] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66333, lrc_seqno=66333, guc_id=0, flags=0x73 in no process [-1] <7> [216.568968] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.569026] ------------[ cut here ]------------ <4> [216.569027] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.569029] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.569101] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.569164] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.569169] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.569172] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.569173] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.569174] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.569179] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.569249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.569251] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.569253] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.569255] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.569256] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.569257] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.569258] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.569260] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.569261] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.569262] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.569264] PKRU: 55555554 <4> [216.569265] Call Trace: <4> [216.569266] <TASK> <4> [216.569270] ? lock_sync+0x100/0x100 <4> [216.569275] ? lock_release+0xd0/0x2b0 <4> [216.569280] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.569286] process_one_work+0x239/0x760 <4> [216.569292] worker_thread+0x200/0x3f0 <4> [216.569295] ? __pfx_worker_thread+0x10/0x10 <4> [216.569297] kthread+0x10d/0x150 <4> [216.569300] ? __pfx_kthread+0x10/0x10 <4> [216.569303] ret_from_fork+0x3d4/0x480 <4> [216.569305] ? __pfx_kthread+0x10/0x10 <4> [216.569309] ret_from_fork_asm+0x1a/0x30 <4> [216.569316] </TASK> <4> [216.569317] irq event stamp: 1762099 <4> [216.569318] hardirqs last enabled at (1762105): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.569321] hardirqs last disabled at (1762110): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.569323] softirqs last enabled at (1761250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.569325] softirqs last disabled at (1761239): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.569328] ---[ end trace 0000000000000000 ]--- <5> [216.570836] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66388, lrc_seqno=66388, guc_id=0, flags=0x73 in no process [-1] <7> [216.570842] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [216.570851] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [216.570943] ------------[ cut here ]------------ <4> [216.570944] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.570946] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:142/6174 <4> [216.571062] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm <7> [216.571009] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [216.571082] gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.571171] CPU: 1 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.571174] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.571175] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.571177] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.571182] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.571252] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.571253] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.571256] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.571257] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.571258] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.571259] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.571260] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.571262] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [216.571263] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.571265] CR2: 00007b7854098268 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [216.571266] PKRU: 55555554 <4> [216.571267] Call Trace: <4> [216.571268] <TASK> <4> [216.571272] ? lock_sync+0x100/0x100 <4> [216.571276] ? lock_release+0xd0/0x2b0 <4> [216.571282] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.571287] process_one_work+0x239/0x760 <4> [216.571293] worker_thread+0x200/0x3f0 <4> [216.571296] ? __pfx_worker_thread+0x10/0x10 <4> [216.571298] kthread+0x10d/0x150 <4> [216.571301] ? __pfx_kthread+0x10/0x10 <4> [216.571305] ret_from_fork+0x3d4/0x480 <4> [216.571307] ? __pfx_kthread+0x10/0x10 <4> [216.571310] ret_from_fork_asm+0x1a/0x30 <4> [216.571317] </TASK> <4> [216.571318] irq event stamp: 816749 <4> [216.571319] hardirqs last enabled at (816755): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.571322] hardirqs last disabled at (816760): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.571324] softirqs last enabled at (814016): [<ffffffff82617917>] neigh_managed_work+0xa7/0xc0 <4> [216.571328] softirqs last disabled at (814012): [<ffffffff82617899>] neigh_managed_work+0x29/0xc0 <4> [216.571331] ---[ end trace 0000000000000000 ]--- <6> [216.571332] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.571403] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.571411] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.571519] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.571721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.571822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.571916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.572004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.572090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.572176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.572264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.572353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.572438] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.572532] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.572648] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.573658] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.583791] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.584042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.585072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.585152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.585226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.585297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.585367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.585435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.585502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.585571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.585638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.585706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.585773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.585861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.585938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.586013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.586087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.586160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.586234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.586306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.586379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.586460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.586540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.586619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.586702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.586787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.586866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.586943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.587020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.587097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.587176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.587255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.587332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.587408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.587492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.587574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.587660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.587744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.587835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.587914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.587992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.588067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.588147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.588224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.588300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.588375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.588454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.588529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.588606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.588681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.588760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.588851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.588929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.589009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.589086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.589162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.589237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.589313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.589386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.589460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.589536] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.589650] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.589654] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66388, lrc_seqno=66388, guc_id=0, flags=0x73 in no process [-1] <7> [216.589656] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.589716] ------------[ cut here ]------------ <4> [216.589717] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.589718] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.589794] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.589859] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.589863] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.589866] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.589867] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.589869] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.589874] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.589943] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.589945] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.589947] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.589948] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.589950] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.589951] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.589952] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.589954] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.589955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.589956] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.589958] PKRU: 55555554 <4> [216.589959] Call Trace: <4> [216.589960] <TASK> <4> [216.589964] ? lock_sync+0x100/0x100 <4> [216.589969] ? lock_release+0xd0/0x2b0 <4> [216.589974] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.589980] process_one_work+0x239/0x760 <4> [216.589986] worker_thread+0x200/0x3f0 <4> [216.589988] ? __pfx_worker_thread+0x10/0x10 <4> [216.589991] kthread+0x10d/0x150 <4> [216.589994] ? __pfx_kthread+0x10/0x10 <4> [216.589997] ret_from_fork+0x3d4/0x480 <4> [216.589999] ? __pfx_kthread+0x10/0x10 <4> [216.590003] ret_from_fork_asm+0x1a/0x30 <4> [216.590010] </TASK> <4> [216.590011] irq event stamp: 1766573 <4> [216.590012] hardirqs last enabled at (1766579): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.590015] hardirqs last disabled at (1766584): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.590017] softirqs last enabled at (1765664): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.590020] softirqs last disabled at (1765657): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.590022] ---[ end trace 0000000000000000 ]--- <6> [216.590024] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.590093] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.590099] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.591352] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.591457] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.591562] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.591768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.591889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.591985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.592073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.592159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.592243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.592328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.592419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.592505] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.592601] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.592717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.593742] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.604475] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.604719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.605772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.605865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.605938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.606009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.606078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.606147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.606217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.606287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.606354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.606421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.606488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.606554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.606621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.606686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.606752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.606831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.606904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.606976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.607047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.607127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.607207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.607288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.607368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.607444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.607521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.607597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.607673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.607751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.607844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.607927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.608008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.608088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.608173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.608256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.608339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.608419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.608498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.608575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.608651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.608729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.608820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.608900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.608977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.609055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.609135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.609211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.609288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.609362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.609438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.609512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.609586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.609666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.609746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.609835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.609912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.609990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.610066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.610140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.610219] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.610332] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.610336] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66388, lrc_seqno=66388, guc_id=0, flags=0x73 in no process [-1] <7> [216.610338] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.610396] ------------[ cut here ]------------ <4> [216.610397] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.610399] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:286/6318 <4> [216.610469] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.610533] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.610537] CPU: 11 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.610540] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.610541] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.610543] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.610548] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.610617] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.610619] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.610621] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.610623] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.610624] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.610625] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.610627] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.610628] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [216.610629] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.610631] CR2: 00007aa45137eff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [216.610632] PKRU: 55555554 <4> [216.610633] Call Trace: <4> [216.610635] <TASK> <4> [216.610638] ? lock_sync+0x100/0x100 <4> [216.610643] ? lock_release+0xd0/0x2b0 <4> [216.610648] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.610654] process_one_work+0x239/0x760 <4> [216.610660] worker_thread+0x200/0x3f0 <4> [216.610663] ? __pfx_worker_thread+0x10/0x10 <4> [216.610665] kthread+0x10d/0x150 <4> [216.610668] ? __pfx_kthread+0x10/0x10 <4> [216.610672] ret_from_fork+0x3d4/0x480 <4> [216.610673] ? __pfx_kthread+0x10/0x10 <4> [216.610677] ret_from_fork_asm+0x1a/0x30 <4> [216.610684] </TASK> <4> [216.610685] irq event stamp: 1100693 <4> [216.610686] hardirqs last enabled at (1100699): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.610689] hardirqs last disabled at (1100704): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.610691] softirqs last enabled at (1099814): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.610694] softirqs last disabled at (1099803): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.610696] ---[ end trace 0000000000000000 ]--- <7> [216.611797] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.611939] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [216.612185] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66443, lrc_seqno=66443, guc_id=0, flags=0x73 in no process [-1] <7> [216.612188] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.612250] ------------[ cut here ]------------ <4> [216.612251] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.612252] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:286/6318 <4> [216.612325] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.612390] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.612395] CPU: 10 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.612398] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.612399] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.612400] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.612405] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.612476] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.612478] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.612480] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.612482] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.612483] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.612484] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.612485] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.612486] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [216.612488] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.612489] CR2: 00007b785fbee000 CR3: 000000013970b002 CR4: 0000000000f72ef0 <4> [216.612491] PKRU: 55555554 <4> [216.612492] Call Trace: <4> [216.612493] <TASK> <4> [216.612497] ? lock_sync+0x100/0x100 <4> [216.612501] ? lock_release+0xd0/0x2b0 <4> [216.612507] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.612512] process_one_work+0x239/0x760 <4> [216.612518] worker_thread+0x200/0x3f0 <4> [216.612521] ? __pfx_worker_thread+0x10/0x10 <4> [216.612523] kthread+0x10d/0x150 <4> [216.612526] ? __pfx_kthread+0x10/0x10 <4> [216.612530] ret_from_fork+0x3d4/0x480 <4> [216.612532] ? __pfx_kthread+0x10/0x10 <4> [216.612535] ret_from_fork_asm+0x1a/0x30 <4> [216.612542] </TASK> <4> [216.612543] irq event stamp: 1103037 <4> [216.612545] hardirqs last enabled at (1103043): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.612547] hardirqs last disabled at (1103048): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.612549] softirqs last enabled at (1101240): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.612552] softirqs last disabled at (1101233): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.612554] ---[ end trace 0000000000000000 ]--- <6> [216.612556] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.612627] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.612633] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.612878] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.613086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.613175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.613267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.613359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.613447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.613535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.613621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.613709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.613797] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.613892] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.614009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.615018] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.624788] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.625040] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.626058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.626137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.626213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.626292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.626369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.626447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.626521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.626596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.626669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.626743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.626828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.626902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.626975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.627049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.627122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.627194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.627267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.627340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.627411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.627493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.627572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.627650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.627729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.627820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.627898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.627975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.628053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.628136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.628218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.628299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.628379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.628460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.628544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.628627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.628710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.628799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.628878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.628954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.629030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.629106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.629186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.629269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.629349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.629426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.629508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.629585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.629662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.629737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.629825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.629900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.629975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.630054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.630135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.630215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.630294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.630372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.630448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.630524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.630605] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.630720] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.630724] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66443, lrc_seqno=66443, guc_id=0, flags=0x73 in no process [-1] <7> [216.630726] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.631642] ------------[ cut here ]------------ <4> [216.631643] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.631645] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:142/6174 <4> [216.631728] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.631802] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.631807] CPU: 1 UID: 0 PID: 6174 Comm: kworker/u64:142 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.631810] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.631811] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.631813] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.631818] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.631888] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.631890] RSP: 0018:ffffc9000dacfca0 EFLAGS: 00010246 <4> [216.631892] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.631894] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.631895] RBP: ffffc9000dacfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.631896] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.631897] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.631899] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [216.631900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.631902] CR2: 00007b7854098268 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [216.631903] PKRU: 55555554 <4> [216.631904] Call Trace: <4> [216.631905] <TASK> <4> [216.631909] ? lock_sync+0x100/0x100 <4> [216.631914] ? lock_release+0xd0/0x2b0 <4> [216.631919] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.631925] process_one_work+0x239/0x760 <4> [216.631931] worker_thread+0x200/0x3f0 <4> [216.631934] ? __pfx_worker_thread+0x10/0x10 <4> [216.631936] kthread+0x10d/0x150 <4> [216.631939] ? __pfx_kthread+0x10/0x10 <4> [216.631943] ret_from_fork+0x3d4/0x480 <4> [216.631945] ? __pfx_kthread+0x10/0x10 <4> [216.631948] ret_from_fork_asm+0x1a/0x30 <4> [216.631955] </TASK> <4> [216.631956] irq event stamp: 822343 <4> [216.631957] hardirqs last enabled at (822349): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.631960] hardirqs last disabled at (822354): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.631962] softirqs last enabled at (821570): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.631965] softirqs last disabled at (821563): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.631967] ---[ end trace 0000000000000000 ]--- <6> [216.631969] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.632039] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.632045] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.632059] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.632161] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.632456] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.632660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.632750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.632852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.632940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.633026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.633111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.633194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.633280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.633361] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.633456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.633572] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.634592] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.644785] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.645034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.646108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.646188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.646263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.646339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.646416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.646490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.646564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.646637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.646711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.646788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.646863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.646936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.647011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.647085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.647159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.647232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.647306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.647379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.647453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.647537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.647618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.647697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.647776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.647866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.647943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.648019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.648095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.648173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.648252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.648328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.648406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.648488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.648575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.648660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.648744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.648833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.648912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.648988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.649064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.649140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.649218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.649294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.649369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.649444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.649526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.649605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.649682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.649758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.649843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.649919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.649994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.650071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.650147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.650223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.650298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.650374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.650447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.650523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.650605] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.650718] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.650722] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66443, lrc_seqno=66443, guc_id=0, flags=0x73 in no process [-1] <7> [216.650724] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.650787] ------------[ cut here ]------------ <4> [216.650789] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.650790] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:286/6318 <4> [216.650863] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.650926] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.650930] CPU: 10 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.650933] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.650934] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.650936] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.650940] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.651010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.651012] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.651014] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.651016] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.651017] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.651018] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.651019] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.651021] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [216.651022] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.651024] CR2: 00007b785fbee000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.651025] PKRU: 55555554 <4> [216.651026] Call Trace: <4> [216.651027] <TASK> <4> [216.651031] ? lock_sync+0x100/0x100 <4> [216.651035] ? lock_release+0xd0/0x2b0 <4> [216.651041] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.651046] process_one_work+0x239/0x760 <4> [216.651052] worker_thread+0x200/0x3f0 <4> [216.651055] ? __pfx_worker_thread+0x10/0x10 <4> [216.651057] kthread+0x10d/0x150 <4> [216.651060] ? __pfx_kthread+0x10/0x10 <4> [216.651064] ret_from_fork+0x3d4/0x480 <4> [216.651066] ? __pfx_kthread+0x10/0x10 <4> [216.651069] ret_from_fork_asm+0x1a/0x30 <4> [216.651076] </TASK> <4> [216.651077] irq event stamp: 1106443 <4> [216.651078] hardirqs last enabled at (1106449): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.651081] hardirqs last disabled at (1106454): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.651083] softirqs last enabled at (1105434): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.651086] softirqs last disabled at (1105427): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.651088] ---[ end trace 0000000000000000 ]--- <5> [216.651661] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66498, lrc_seqno=66498, guc_id=0, flags=0x73 in no process [-1] <7> [216.651664] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.651722] ------------[ cut here ]------------ <4> [216.651724] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.651725] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:286/6318 <4> [216.651802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.651868] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.651873] CPU: 10 UID: 0 PID: 6318 Comm: kworker/u64:286 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.651876] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.651877] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.651879] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.651883] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.651954] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.651956] RSP: 0018:ffffc9000df2fca0 EFLAGS: 00010246 <4> [216.651958] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.651960] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.651961] RBP: ffffc9000df2fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.651963] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.651964] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.651966] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [216.651967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.651969] CR2: 00007b785fbee000 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [216.651970] PKRU: 55555554 <4> [216.651972] Call Trace: <4> [216.651973] <TASK> <4> [216.651977] ? lock_sync+0x100/0x100 <4> [216.651981] ? lock_release+0xd0/0x2b0 <4> [216.651987] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.651992] process_one_work+0x239/0x760 <4> [216.651998] worker_thread+0x200/0x3f0 <4> [216.652001] ? __pfx_worker_thread+0x10/0x10 <4> [216.652003] kthread+0x10d/0x150 <4> [216.652006] ? __pfx_kthread+0x10/0x10 <4> [216.652010] ret_from_fork+0x3d4/0x480 <4> [216.652011] ? __pfx_kthread+0x10/0x10 <4> [216.652015] ret_from_fork_asm+0x1a/0x30 <4> [216.652022] </TASK> <4> [216.652023] irq event stamp: 1109047 <4> [216.652024] hardirqs last enabled at (1109053): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.652027] hardirqs last disabled at (1109058): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.652029] softirqs last enabled at (1105434): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.652031] softirqs last disabled at (1105427): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.652033] ---[ end trace 0000000000000000 ]--- <6> [216.652809] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [216.653027] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [216.653033] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [216.653098] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [216.653203] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [216.653307] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [216.653513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [216.653602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [216.653695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [216.653790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [216.653879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [216.653966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [216.654056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [216.654146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [216.654230] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [216.654322] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [216.654436] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [216.655445] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [216.665787] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [216.666037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [216.667096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [216.667175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [216.667244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [216.667313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [216.667383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [216.667453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [216.667523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [216.667591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [216.667660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [216.667727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [216.667799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [216.667872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [216.667944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [216.668017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [216.668090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [216.668162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [216.668235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [216.668307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [216.668379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [216.668461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [216.668543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [216.668621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [216.668699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [216.668776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [216.668873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [216.668949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [216.669027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [216.669109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [216.669190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [216.669268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [216.669348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [216.669427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [216.669512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [216.669595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [216.669679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [216.669760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [216.669850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [216.669928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [216.670008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [216.670087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [216.670166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [216.670243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [216.670319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [216.670394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [216.670474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [216.670550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [216.670626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [216.670701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [216.670783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [216.670859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [216.670937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [216.671017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [216.671096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [216.671173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [216.671250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [216.671327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [216.671402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [216.671482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [216.671564] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [216.671679] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [216.671682] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=66498, lrc_seqno=66498, guc_id=0, flags=0x73 in no process [-1] <7> [216.671685] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [216.671744] ------------[ cut here ]------------ <4> [216.671745] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [216.671746] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:143/6175 <4> [216.671829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore <4> [216.671895] nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [216.671900] CPU: 0 UID: 0 PID: 6175 Comm: kworker/u64:143 Tainted: G S U W 7.0.0-rc7-lgci-xe-xe-4877-97d8833ffba6bd3d6-debug+ #1 PREEMPT(lazy) <4> [216.671903] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [216.671904] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [216.671905] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [216.671910] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [216.671980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [216.671982] RSP: 0018:ffffc9000dad7ca0 EFLAGS: 00010246 <4> [216.671984] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000 <4> [216.671986] RDX: ffff888104bdee10 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0 <4> [216.671987] RBP: ffffc9000dad7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [216.671988] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [216.671989] R13: ffff888104bdee10 R14: ffff888136dc5018 R15: 00000000ffffffc2 <4> [216.671991] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [216.671992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [216.671994] CR2: 00007aa4503ff000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [216.671995] PKRU: 55555554 <4> [216.671996] Call Trace: <4> [216.671997] <TASK> <4> [216.672001] ? lock_sync+0x100/0x100 <4> [216.672006] ? lock_release+0xd0/0x2b0 <4> [216.672011] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [216.672017] process_one_work+0x239/0x760 <4> [216.672023] worker_thread+0x200/0x3f0 <4> [216.672026] ? __pfx_worker_thread+0x10/0x10 <4> [216.672028] kthread+0x10d/0x150 <4> [216.672031] ? __pfx_kthread+0x10/0x10 <4> [216.672035] ret_from_fork+0x3d4/0x480 <4> [216.672037] ? __pfx_kthread+0x10/0x10 <4> [216.672040] ret_from_fork_asm+0x1a/0x30 <4> [216.672047] </TASK> <4> [216.672049] irq event stamp: 1772063 <4> [216.672050] hardirqs last enabled at (1772069): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [216.672053] hardirqs last disabled at (1772074): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [216.672055] softirqs last enabled at (1771062): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.672057] softirqs last disabled at (1771055): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [216.672060] ---[ end trace 0000000000000000 ]---

<4> [215.251231] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.251393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.270335] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.270490] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.292247] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.292404] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.293401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.293566] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.313240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.313390] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.334200] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.334353] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.336046] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.336192] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.355750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.355929] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.375211] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.375367] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.377312] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.377461] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.396776] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.396941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.415871] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.416022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.416868] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.417015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.436949] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.437096] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.457784] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.457958] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.458815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.458976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.478908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.479061] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.498567] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.498714] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.500456] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.500600] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.520246] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.520397] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.540767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.540918] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.541933] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.542079] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.561714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.561870] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.580873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.581023] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.581820] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.581966] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.601825] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.601976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.621897] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.622047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.622851] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.622995] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.643711] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.643866] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.663725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.663878] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.664912] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.665060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.683818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.683967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.703453] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.703601] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.705675] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.705876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.724813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.724976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.745352] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.745503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.746721] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.746874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.765942] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.766092] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.786426] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.786562] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.788792] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.788940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.807818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.807968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.828493] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.828640] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.830253] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.830397] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.848921] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.849070] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.869589] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.869737] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.871560] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.871754] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.890910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.891058] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.910826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.910982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.912350] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.912509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.930682] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.930834] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.950489] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.950624] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.951413] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.951559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.971614] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.971750] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.991724] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.991879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [215.993711] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [215.993868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.013756] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.013916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.032926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.033074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.034864] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.035024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.054036] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.054203] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.073947] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.074109] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.074987] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.075156] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.095209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.095357] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.115941] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.116088] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.117866] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.118010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.136858] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.137005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.156895] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.157041] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.157853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.158000] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.177926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.178075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.199157] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.199311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.200485] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.200916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.220310] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.220459] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.241021] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.241168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.241978] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.242121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.261901] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.262052] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.282520] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.282672] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.284298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.284444] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.302920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.303069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.322819] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.322969] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.324925] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.325072] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.343963] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.344112] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.363925] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.364074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.365741] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.365889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.384853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.385001] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.406454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.406603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.408949] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.409098] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.427555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.427689] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.447573] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.447708] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.449865] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.450049] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.468543] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.468678] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.488410] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.488547] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.490272] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.490417] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.508526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.508661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.528045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.528192] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.529915] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.530060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.549807] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.549959] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.569101] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.569249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.571082] gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [216.571252] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.589794] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.589943] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.610469] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.610617] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.612325] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.612476] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.631728] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.631888] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.650863] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.651010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.651802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.651954] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [216.671829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic spi_nor asus_nb_wmi mtd asus_wmi sparse_keymap mei_pxp mei_hdcp platform_profile binfmt_misc wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel aesni_intel snd_intel_dspcfg rapl r8169 snd_hda_codec snd_hda_core intel_cstate usbhid hid snd_hwdep video realtek snd_pcm i2c_i801 snd_timer i2c_mux snd spi_intel_pci i2c_smbus spi_intel soundcore idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class mei_me intel_pmc_ssram_telemetry mei intel_vsec acpi_tad acpi_pad pinctrl_alderlake wmi dm_multipath msr nvme_fabrics fuse efi_pstore

<4> [216.671980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching