igt@xe_pat@pt-caching on shard-bmg@xe-pw-165141v1 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-7
Igt-Version	IGT-Version: 2.4-g5b279a8b7 (x86_64) (Linux: 7.0.0-lgci-xe-xe-pw-165141v1-debug+ x86_64)
Out	Using IGT_SRANDOM=1776735660 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 Subtest pt-caching: SUCCESS (17.191s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching Subtest pt-caching: SUCCESS (17.191s)
Dmesg Scroll to first warning	<6> [232.710567] Console: switching to colour dummy device 80x25 <6> [232.710910] [IGT] xe_pat: executing <6> [232.734564] [IGT] xe_pat: starting subtest pt-caching <6> [232.736449] xe 0000:03:00.0: [drm] PL2 disabled for channel 0, val 0x00000000 <7> [232.754814] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x21201f1f <7> [232.754968] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x20202021 <6> [233.403890] xe 0000:03:00.0: [drm] PL2 disabled for channel 0, val 0x00000000 <7> [233.407630] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x24232020 <7> [233.407784] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x23232424 <6> [233.949780] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000000001790000 FaultType: 0 AccessType: 1 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [233.949793] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [233.949844] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <5> [233.950629] xe 0000:03:00.0: [drm] Tile0: GT0: log buffer overflow <7> [234.472537] xe 0000:03:00.0: [drm:xe_guc_capture_process [xe]] Tile0: GT0: Capture extraction failed:-5 <6> [234.472773] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [234.473081] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45710, lrc_seqno=45710, guc_id=0, flags=0x73 in no process [-1] <7> [234.473086] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.473179] ------------[ cut here ]------------ <4> [234.473181] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.473182] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [234.473255] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.473325] autofs4 [last unloaded: snd_hda_intel] <4> [234.473329] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.473332] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [234.473333] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.473335] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.473341] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.473408] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.473409] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.473412] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.473413] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.473414] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.473415] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.473416] R13: ffff888103e7d010 R14: ffff888252dd0000 R15: 00000000fffffffb <4> [234.473417] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.473419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.473420] CR2: 0000000000000000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.473421] PKRU: 55555554 <4> [234.473423] Call Trace: <4> [234.473424] <TASK> <4> [234.473428] ? lock_sync+0x100/0x100 <4> [234.473433] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [234.473438] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.473444] process_one_work+0x239/0x760 <4> [234.473450] worker_thread+0x200/0x3f0 <4> [234.473453] ? __pfx_worker_thread+0x10/0x10 <4> [234.473455] kthread+0x10d/0x150 <4> [234.473458] ? __pfx_kthread+0x10/0x10 <4> [234.473461] ret_from_fork+0x3d4/0x480 <4> [234.473464] ? __pfx_kthread+0x10/0x10 <4> [234.473467] ret_from_fork_asm+0x1a/0x30 <4> [234.473474] </TASK> <4> [234.473475] irq event stamp: 565025 <4> [234.473476] hardirqs last enabled at (565031): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.473480] hardirqs last disabled at (565036): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.473482] softirqs last enabled at (560116): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.473484] softirqs last disabled at (560109): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.473486] ---[ end trace 0000000000000000 ]--- <6> [234.473488] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.473555] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.473680] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.473824] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.474252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.474341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.474428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.474511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.474593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.474696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.474782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.474863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.474940] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.475026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.475132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.476232] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.487094] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.487353] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.488915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.488991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.489065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.489138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.489206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.489273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.489340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.489406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.489472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.489538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.489605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.489686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.489765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.489836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.489908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.489978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.490048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.490117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.490186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.490261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.490336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.490408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.490482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.490573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.490677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.490751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.490822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.490896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.490969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.491041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.491114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.491186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.491264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.491346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.491425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.491501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.491575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.491650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.491728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.491801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.491873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.491943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.492016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.492088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.492163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.492234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.492307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.492377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.492449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.492518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.492587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.492667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.492744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.492821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.492896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.492975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.493050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.493126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.493208] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.494521] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.494527] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45710, lrc_seqno=45710, guc_id=0, flags=0x73 in no process [-1] <7> [234.494529] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.494594] ------------[ cut here ]------------ <4> [234.494595] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.494596] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:4/204 <4> [234.494680] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.494751] autofs4 [last unloaded: snd_hda_intel] <4> [234.494756] CPU: 5 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.494759] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.494760] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.494762] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.494767] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.494838] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.494840] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [234.494843] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.494844] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.494845] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.494847] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.494848] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.494849] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.494851] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.494852] CR2: 000063cef3bb4c78 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.494854] PKRU: 55555554 <4> [234.494855] Call Trace: <4> [234.494856] <TASK> <4> [234.494860] ? lock_sync+0x100/0x100 <4> [234.494866] ? lock_release+0xd0/0x2b0 <4> [234.494871] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.494877] process_one_work+0x239/0x760 <4> [234.494884] worker_thread+0x200/0x3f0 <4> [234.494887] ? __pfx_worker_thread+0x10/0x10 <4> [234.494889] kthread+0x10d/0x150 <4> [234.494893] ? __pfx_kthread+0x10/0x10 <4> [234.494896] ret_from_fork+0x3d4/0x480 <4> [234.494899] ? __pfx_kthread+0x10/0x10 <4> [234.494902] ret_from_fork_asm+0x1a/0x30 <4> [234.494910] </TASK> <4> [234.494911] irq event stamp: 674007 <4> [234.494912] hardirqs last enabled at (674013): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.494915] hardirqs last disabled at (674018): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.494918] softirqs last enabled at (673110): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.494920] softirqs last disabled at (673103): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.494923] ---[ end trace 0000000000000000 ]--- <7> [234.494938] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.495045] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [234.495144] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.495215] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.495222] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.495635] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.495858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.495957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.496058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.496152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.496244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.496335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.496426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.496520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.496608] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.496750] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.496866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.497879] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.507639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.507889] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.508918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.508998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.509075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.509152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.509228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.509303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.509379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.509453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.509527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.509602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.509690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.509766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.509842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.509918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.509992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.510067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.510141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.510214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.510288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.510370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.510451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.510530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.510611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.510702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.510784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.510863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.510939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.511019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.511099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.511178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.511256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.511338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.511426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.511514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.511600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.511690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.511770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.511848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.511924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.512004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.512089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.512172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.512252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.512330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.512411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.512489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.512567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.512654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.512732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.512807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.512883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.512963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.513040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.513118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.513197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.513279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.513358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.513436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.513517] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.513632] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.513636] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45710, lrc_seqno=45710, guc_id=0, flags=0x73 in no process [-1] <7> [234.513639] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.513697] ------------[ cut here ]------------ <4> [234.513699] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.513700] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:1/120 <4> [234.513770] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.513839] autofs4 [last unloaded: snd_hda_intel] <4> [234.513843] CPU: 0 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.513846] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.513847] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.513849] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.513854] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.513924] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.513926] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.513928] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.513930] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.513931] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.513932] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.513933] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.513935] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.513936] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.513938] CR2: 00007dd8c736a008 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [234.513939] PKRU: 55555554 <4> [234.513940] Call Trace: <4> [234.513942] <TASK> <4> [234.513946] ? lock_sync+0x100/0x100 <4> [234.513951] ? lock_release+0xd0/0x2b0 <4> [234.513957] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.513962] process_one_work+0x239/0x760 <4> [234.513969] worker_thread+0x200/0x3f0 <4> [234.513972] ? __pfx_worker_thread+0x10/0x10 <4> [234.513974] kthread+0x10d/0x150 <4> [234.513977] ? __pfx_kthread+0x10/0x10 <4> [234.513981] ret_from_fork+0x3d4/0x480 <4> [234.513983] ? __pfx_kthread+0x10/0x10 <4> [234.513987] ret_from_fork_asm+0x1a/0x30 <4> [234.513995] </TASK> <4> [234.513996] irq event stamp: 569319 <4> [234.513997] hardirqs last enabled at (569325): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.514000] hardirqs last disabled at (569330): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.514002] softirqs last enabled at (568404): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.514005] softirqs last disabled at (568383): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.514007] ---[ end trace 0000000000000000 ]--- <5> [234.514483] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45765, lrc_seqno=45765, guc_id=0, flags=0x73 in no process [-1] <7> [234.514490] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.514875] ------------[ cut here ]------------ <4> [234.514877] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.514881] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:3/191 <4> [234.515045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.515179] autofs4 [last unloaded: snd_hda_intel] <4> [234.515187] CPU: 9 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.515191] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.515193] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.515196] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.515207] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.515336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.515339] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.515343] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.515346] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.515348] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.515351] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.515353] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.515356] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [234.515359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.515361] CR2: 000073be891b292d CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.515364] PKRU: 55555554 <4> [234.515367] Call Trace: <4> [234.515369] <TASK> <4> [234.515379] ? lock_sync+0x100/0x100 <4> [234.515388] ? lock_release+0xd0/0x2b0 <4> [234.515398] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.515409] process_one_work+0x239/0x760 <4> [234.515422] worker_thread+0x200/0x3f0 <4> [234.515427] ? __pfx_worker_thread+0x10/0x10 <4> [234.515431] kthread+0x10d/0x150 <4> [234.515437] ? __pfx_kthread+0x10/0x10 <4> [234.515443] ret_from_fork+0x3d4/0x480 <4> [234.515447] ? __pfx_kthread+0x10/0x10 <4> [234.515453] ret_from_fork_asm+0x1a/0x30 <4> [234.515466] </TASK> <4> [234.515469] irq event stamp: 1342777 <4> [234.515471] hardirqs last enabled at (1342783): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.515476] hardirqs last disabled at (1342788): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.515480] softirqs last enabled at (1342014): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.515484] softirqs last disabled at (1342007): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.515488] ---[ end trace 0000000000000000 ]--- <6> [234.515502] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.515594] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.515794] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.515810] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.515920] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.516141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.516355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.516453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.516554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.516657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.516752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.516845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.516936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.517029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.517119] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.517224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.517348] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.518365] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.528638] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.528892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.529956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.530084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.530163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.530241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.530317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.530395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.530471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.530548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.530625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.530718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.530792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.530866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.530941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.531015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.531092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.531168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.531244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.531318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.531393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.531475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.531556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.531640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.531721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.531804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.531885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.531963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.532042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.532125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.532209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.532289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.532370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.532449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.532532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.532618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.532725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.532811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.532893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.532972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.533051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.533127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.533208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.533286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.533362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.533439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.533519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.533597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.533689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.533770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.533851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.533930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.534007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.534089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.534170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.534251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.534329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.534408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.534485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.534562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.534646] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.534758] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.534763] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45765, lrc_seqno=45765, guc_id=0, flags=0x73 in no process [-1] <7> [234.534765] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.534824] ------------[ cut here ]------------ <4> [234.534825] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.534826] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:3/191 <4> [234.534898] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.534964] autofs4 [last unloaded: snd_hda_intel] <4> [234.534969] CPU: 3 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.534972] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.534973] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.534974] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.534980] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.535048] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.535050] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.535053] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.535054] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.535055] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.535057] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.535058] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.535059] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.535061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.535062] CR2: 0000749c7c084478 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [234.535064] PKRU: 55555554 <4> [234.535065] Call Trace: <4> [234.535066] <TASK> <4> [234.535070] ? lock_sync+0x100/0x100 <4> [234.535075] ? lock_release+0xd0/0x2b0 <4> [234.535080] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.535086] process_one_work+0x239/0x760 <4> [234.535092] worker_thread+0x200/0x3f0 <4> [234.535095] ? __pfx_worker_thread+0x10/0x10 <4> [234.535098] kthread+0x10d/0x150 <4> [234.535101] ? __pfx_kthread+0x10/0x10 <4> [234.535104] ret_from_fork+0x3d4/0x480 <4> [234.535106] ? __pfx_kthread+0x10/0x10 <4> [234.535110] ret_from_fork_asm+0x1a/0x30 <4> [234.535117] </TASK> <4> [234.535118] irq event stamp: 1345897 <4> [234.535119] hardirqs last enabled at (1345903): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.535122] hardirqs last disabled at (1345908): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.535125] softirqs last enabled at (1344976): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.535127] softirqs last disabled at (1344969): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.535130] ---[ end trace 0000000000000000 ]--- <6> [234.535132] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.535201] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.535207] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.535592] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.535806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.535895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.535987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.536073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.536158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.536242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.536327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.536413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.536494] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.536593] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.536723] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.537734] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.548458] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.548714] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.549666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.549748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.549826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.549905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.549982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.550057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.550133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.550208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.550283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.550360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.550436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.550511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.550586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.550672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.550746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.550820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.550893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.550966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.551040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.551123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.551204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.551287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.551370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.551449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.551527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.551603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.551691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.551771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.551851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.551929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.552008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.552088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.552172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.552257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.552342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.552424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.552507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.552590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.552687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.552765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.552847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.552932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.553014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.553093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.553174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.553252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.553330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.553411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.553492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.553569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.553650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.553731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.553813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.553892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.553971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.554051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.554128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.554204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.554284] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.554396] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.554400] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45765, lrc_seqno=45765, guc_id=0, flags=0x73 in no process [-1] <7> [234.554403] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.554462] ------------[ cut here ]------------ <4> [234.554463] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.554464] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:3/191 <4> [234.554537] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.554602] autofs4 [last unloaded: snd_hda_intel] <4> [234.554606] CPU: 3 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.554609] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.554610] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.554612] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.554617] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.554702] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.554704] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.554706] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.554708] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.554709] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.554710] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.554712] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.554713] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.554715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.554717] CR2: 0000749c7c084478 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.554718] PKRU: 55555554 <4> [234.554720] Call Trace: <4> [234.554721] <TASK> <4> [234.554725] ? lock_sync+0x100/0x100 <4> [234.554729] ? lock_release+0xd0/0x2b0 <4> [234.554735] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.554740] process_one_work+0x239/0x760 <4> [234.554746] worker_thread+0x200/0x3f0 <4> [234.554749] ? __pfx_worker_thread+0x10/0x10 <4> [234.554752] kthread+0x10d/0x150 <4> [234.554755] ? __pfx_kthread+0x10/0x10 <4> [234.554758] ret_from_fork+0x3d4/0x480 <4> [234.554760] ? __pfx_kthread+0x10/0x10 <4> [234.554764] ret_from_fork_asm+0x1a/0x30 <4> [234.554771] </TASK> <4> [234.554773] irq event stamp: 1348991 <4> [234.554774] hardirqs last enabled at (1348997): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.554777] hardirqs last disabled at (1349002): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.554779] softirqs last enabled at (1348012): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.554781] softirqs last disabled at (1348005): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.554784] ---[ end trace 0000000000000000 ]--- <5> [234.556066] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45820, lrc_seqno=45820, guc_id=0, flags=0x73 in no process [-1] <7> [234.556069] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.556130] ------------[ cut here ]------------ <4> [234.556132] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.556133] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:3/191 <4> [234.556203] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.556267] autofs4 [last unloaded: snd_hda_intel] <4> [234.556270] CPU: 3 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.556273] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.556274] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.556275] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.556280] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.556349] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.556351] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.556353] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.556354] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.556355] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.556357] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.556358] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.556359] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.556361] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.556362] CR2: 0000749c7c084478 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.556363] PKRU: 55555554 <4> [234.556364] Call Trace: <4> [234.556365] <TASK> <4> [234.556369] ? lock_sync+0x100/0x100 <4> [234.556373] ? lock_release+0xd0/0x2b0 <4> [234.556379] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.556384] process_one_work+0x239/0x760 <4> [234.556390] worker_thread+0x200/0x3f0 <4> [234.556393] ? __pfx_worker_thread+0x10/0x10 <4> [234.556395] kthread+0x10d/0x150 <4> [234.556398] ? __pfx_kthread+0x10/0x10 <4> [234.556402] ret_from_fork+0x3d4/0x480 <4> [234.556403] ? __pfx_kthread+0x10/0x10 <4> [234.556407] ret_from_fork_asm+0x1a/0x30 <4> [234.556414] </TASK> <4> [234.556415] irq event stamp: 1350871 <4> [234.556416] hardirqs last enabled at (1350877): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.556419] hardirqs last disabled at (1350882): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.556421] softirqs last enabled at (1348012): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.556423] softirqs last disabled at (1348005): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.556426] ---[ end trace 0000000000000000 ]--- <6> [234.556427] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.556496] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.556502] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.556650] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.556756] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.556864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.557074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.557167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.557263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.557355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.557444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.557530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.557615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.557743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.557830] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.557926] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.558045] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.559061] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.569640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.569915] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.570956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.571035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.571112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.571190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.571269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.571349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.571425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.571502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.571577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.571665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.571755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.571831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.571905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.571979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.572052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.572125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.572198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.572270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.572343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.572424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.572505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.572584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.572675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.572772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.572850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.572928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.573009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.573091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.573172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.573251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.573330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.573409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.573493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.573577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.573671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.573770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.573849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.573930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.574012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.574092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.574176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.574254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.574332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.574409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.574489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.574567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.574653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.574761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.574839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.574918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.574998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.575079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.575157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.575234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.575313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.575395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.575473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.575552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.575639] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.575775] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.575779] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45820, lrc_seqno=45820, guc_id=0, flags=0x73 in no process [-1] <7> [234.575782] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.575841] ------------[ cut here ]------------ <4> [234.575842] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.575844] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:1/120 <4> [234.575916] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.575982] autofs4 [last unloaded: snd_hda_intel] <4> [234.575986] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.575989] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.575990] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.575991] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.575997] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.576068] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.576069] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.576072] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.576073] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.576074] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.576076] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.576077] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.576078] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.576080] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.576081] CR2: 0000585db1cdba90 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.576083] PKRU: 55555554 <4> [234.576084] Call Trace: <4> [234.576085] <TASK> <4> [234.576089] ? lock_sync+0x100/0x100 <4> [234.576094] ? lock_release+0xd0/0x2b0 <4> [234.576099] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.576105] process_one_work+0x239/0x760 <4> [234.576111] worker_thread+0x200/0x3f0 <4> [234.576113] ? __pfx_worker_thread+0x10/0x10 <4> [234.576116] kthread+0x10d/0x150 <4> [234.576119] ? __pfx_kthread+0x10/0x10 <4> [234.576123] ret_from_fork+0x3d4/0x480 <4> [234.576125] ? __pfx_kthread+0x10/0x10 <4> [234.576128] ret_from_fork_asm+0x1a/0x30 <4> [234.576135] </TASK> <4> [234.576137] irq event stamp: 575045 <4> [234.576138] hardirqs last enabled at (575051): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.576141] hardirqs last disabled at (575056): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.576143] softirqs last enabled at (574124): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.576145] softirqs last disabled at (574103): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.576148] ---[ end trace 0000000000000000 ]--- <6> [234.576149] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.576219] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.576225] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.576647] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.577118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.577226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.577330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.577427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.577524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.577615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.577721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.577816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.577903] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.578003] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.578125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.579141] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.589638] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.589891] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.590921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.591007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.591088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.591172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.591257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.591339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.591419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.591499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.591579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.591683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.591761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.591841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.591919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.591997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.592076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.592155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.592234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.592312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.592389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.592475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.592561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.592654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.592741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.592824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.592907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.592989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.593071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.593158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.593245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.593331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.593416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.593499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.593587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.593685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.593774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.593859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.593943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.594025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.594107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.594190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.594278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.594364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.594449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.594532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.594618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.594711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.594795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.594876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.594959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.595039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.595120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.595203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.595284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.595366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.595449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.595536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.595619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.595714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.595800] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.596059] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.596064] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45820, lrc_seqno=45820, guc_id=0, flags=0x73 in no process [-1] <7> [234.596066] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.596132] ------------[ cut here ]------------ <4> [234.596134] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.596135] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [234.596213] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.596278] autofs4 [last unloaded: snd_hda_intel] <4> [234.596282] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.596286] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.596287] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.596288] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.596293] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.596370] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.596371] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.596374] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.596375] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.596377] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.596378] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.596379] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.596380] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.596382] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.596383] CR2: 0000749c879c1000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [234.596385] PKRU: 55555554 <4> [234.596386] Call Trace: <4> [234.596387] <TASK> <4> [234.596391] ? lock_sync+0x100/0x100 <4> [234.596396] ? lock_release+0xd0/0x2b0 <4> [234.596401] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.596407] process_one_work+0x239/0x760 <4> [234.596414] worker_thread+0x200/0x3f0 <4> [234.596416] ? __pfx_worker_thread+0x10/0x10 <4> [234.596419] kthread+0x10d/0x150 <4> [234.596422] ? __pfx_kthread+0x10/0x10 <4> [234.596426] ret_from_fork+0x3d4/0x480 <4> [234.596428] ? __pfx_kthread+0x10/0x10 <4> [234.596431] ret_from_fork_asm+0x1a/0x30 <4> [234.596438] </TASK> <4> [234.596440] irq event stamp: 578155 <4> [234.596441] hardirqs last enabled at (578161): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.596444] hardirqs last disabled at (578166): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.596446] softirqs last enabled at (577306): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.596448] softirqs last disabled at (577295): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.596451] ---[ end trace 0000000000000000 ]--- <5> [234.597659] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45875, lrc_seqno=45875, guc_id=0, flags=0x73 in no process [-1] <7> [234.597663] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.597732] ------------[ cut here ]------------ <4> [234.597733] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.597735] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [234.597810] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.597873] autofs4 [last unloaded: snd_hda_intel] <4> [234.597876] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.597879] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.597880] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.597881] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.597886] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.597961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.597963] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.597965] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.597966] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.597967] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.597969] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.597970] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.597971] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.597973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.597974] CR2: 0000749c879c1000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [234.597975] PKRU: 55555554 <4> [234.597977] Call Trace: <4> [234.597978] <TASK> <4> [234.597981] ? lock_sync+0x100/0x100 <4> [234.597985] ? lock_release+0xd0/0x2b0 <4> [234.597991] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.597997] process_one_work+0x239/0x760 <4> [234.598003] worker_thread+0x200/0x3f0 <4> [234.598006] ? __pfx_worker_thread+0x10/0x10 <4> [234.598008] kthread+0x10d/0x150 <4> [234.598011] ? __pfx_kthread+0x10/0x10 <4> [234.598014] ret_from_fork+0x3d4/0x480 <4> [234.598016] ? __pfx_kthread+0x10/0x10 <4> [234.598020] ret_from_fork_asm+0x1a/0x30 <4> [234.598027] </TASK> <4> [234.598028] irq event stamp: 580357 <4> [234.598029] hardirqs last enabled at (580363): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.598032] hardirqs last disabled at (580368): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.598034] softirqs last enabled at (577306): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.598037] softirqs last disabled at (577295): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.598039] ---[ end trace 0000000000000000 ]--- <6> [234.598041] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.598116] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.598121] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.598312] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.598424] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.598782] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.598998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.599096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.599196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.599290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.599382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.599474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.599569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.599692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.599780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.599879] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.600002] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.601012] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.611639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.611894] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.612919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.613003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.613083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.613166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.613247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.613328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.613410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.613493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.613576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.613682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.613762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.613841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.613920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.613999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.614078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.614157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.614237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.614315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.614393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.614478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.614567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.614660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.614747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.614830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.614913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.614995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.615076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.615160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.615245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.615329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.615416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.615504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.615595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.615694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.615783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.615870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.615954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.616036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.616118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.616204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.616293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.616379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.616464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.616546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.616636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.616718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.616801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.616884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.616967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.617050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.617136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.617222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.617306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.617389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.617470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.617553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.617636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.617717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.617801] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.617917] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.617921] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45875, lrc_seqno=45875, guc_id=0, flags=0x73 in no process [-1] <7> [234.617923] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.617984] ------------[ cut here ]------------ <4> [234.617985] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.617987] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [234.618063] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.618127] autofs4 [last unloaded: snd_hda_intel] <4> [234.618130] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.618133] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.618134] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.618136] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.618141] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.618214] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.618216] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.618218] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.618219] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.618221] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.618222] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.618223] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.618224] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.618226] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.618227] CR2: 0000749c879c1000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [234.618229] PKRU: 55555554 <4> [234.618230] Call Trace: <4> [234.618231] <TASK> <4> [234.618235] ? lock_sync+0x100/0x100 <4> [234.618239] ? lock_release+0xd0/0x2b0 <4> [234.618244] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.618250] process_one_work+0x239/0x760 <4> [234.618256] worker_thread+0x200/0x3f0 <4> [234.618259] ? __pfx_worker_thread+0x10/0x10 <4> [234.618261] kthread+0x10d/0x150 <4> [234.618264] ? __pfx_kthread+0x10/0x10 <4> [234.618268] ret_from_fork+0x3d4/0x480 <4> [234.618270] ? __pfx_kthread+0x10/0x10 <4> [234.618273] ret_from_fork_asm+0x1a/0x30 <4> [234.618280] </TASK> <4> [234.618281] irq event stamp: 583449 <4> [234.618283] hardirqs last enabled at (583455): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.618286] hardirqs last disabled at (583460): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.618288] softirqs last enabled at (582426): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.618290] softirqs last disabled at (582419): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.618292] ---[ end trace 0000000000000000 ]--- <6> [234.618294] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.618367] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.618373] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.619843] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.619953] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.620060] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.620269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.620363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.620455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.620543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.620634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.620719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.620806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.620893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.620976] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.621070] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.621189] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.622207] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.632642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.632916] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.633949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.634029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.634106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.634184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.634261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.634338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.634416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.634496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.634573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.634655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.634731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.634806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.634880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.634955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.635030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.635103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.635177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.635251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.635325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.635409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.635492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.635571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.635661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.635740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.635818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.635896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.635973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.636052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.636134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.636214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.636298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.636381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.636468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.636553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.636643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.636724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.636805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.636884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.636967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.637046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.637130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.637210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.637290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.637368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.637449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.637528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.637605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.637699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.637785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.637864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.637942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.638023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.638101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.638179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.638256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.638334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.638410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.638487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.638568] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.638860] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.638866] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45875, lrc_seqno=45875, guc_id=0, flags=0x73 in no process [-1] <7> [234.638868] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.638931] ------------[ cut here ]------------ <4> [234.638933] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.638934] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:3/191 <4> [234.639009] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.639075] autofs4 [last unloaded: snd_hda_intel] <4> [234.639079] CPU: 3 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.639082] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.639083] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.639085] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.639090] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.639162] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.639164] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.639166] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.639167] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.639169] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.639170] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.639171] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.639173] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.639174] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.639175] CR2: 0000749c7c084478 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [234.639177] PKRU: 55555554 <4> [234.639178] Call Trace: <4> [234.639179] <TASK> <4> [234.639183] ? lock_sync+0x100/0x100 <4> [234.639187] ? lock_release+0xd0/0x2b0 <4> [234.639193] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.639198] process_one_work+0x239/0x760 <4> [234.639205] worker_thread+0x200/0x3f0 <4> [234.639208] ? __pfx_worker_thread+0x10/0x10 <4> [234.639210] kthread+0x10d/0x150 <4> [234.639213] ? __pfx_kthread+0x10/0x10 <4> [234.639217] ret_from_fork+0x3d4/0x480 <4> [234.639219] ? __pfx_kthread+0x10/0x10 <4> [234.639222] ret_from_fork_asm+0x1a/0x30 <4> [234.639229] </TASK> <4> [234.639230] irq event stamp: 1355365 <4> [234.639232] hardirqs last enabled at (1355371): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.639234] hardirqs last disabled at (1355376): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.639237] softirqs last enabled at (1354524): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.639239] softirqs last disabled at (1354513): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.639241] ---[ end trace 0000000000000000 ]--- <5> [234.640460] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45930, lrc_seqno=45930, guc_id=0, flags=0x73 in no process [-1] <7> [234.640464] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.640526] ------------[ cut here ]------------ <4> [234.640527] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.640529] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:3/191 <4> [234.640608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.640705] autofs4 [last unloaded: snd_hda_intel] <4> [234.640709] CPU: 3 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.640712] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.640714] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.640715] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.640721] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.640792] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.640793] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.640796] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.640798] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.640799] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.640801] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.640802] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.640804] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.640806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.640807] CR2: 0000749c7c084478 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [234.640809] PKRU: 55555554 <4> [234.640811] Call Trace: <4> [234.640812] <TASK> <4> [234.640816] ? lock_sync+0x100/0x100 <4> [234.640821] ? lock_release+0xd0/0x2b0 <4> [234.640826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.640832] process_one_work+0x239/0x760 <4> [234.640838] worker_thread+0x200/0x3f0 <4> [234.640841] ? __pfx_worker_thread+0x10/0x10 <4> [234.640844] kthread+0x10d/0x150 <4> [234.640847] ? __pfx_kthread+0x10/0x10 <4> [234.640851] ret_from_fork+0x3d4/0x480 <4> [234.640853] ? __pfx_kthread+0x10/0x10 <4> [234.640857] ret_from_fork_asm+0x1a/0x30 <4> [234.640864] </TASK> <4> [234.640866] irq event stamp: 1357333 <4> [234.640867] hardirqs last enabled at (1357339): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.640870] hardirqs last disabled at (1357344): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.640873] softirqs last enabled at (1354524): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.640876] softirqs last disabled at (1354513): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.640878] ---[ end trace 0000000000000000 ]--- <7> [234.640893] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.640999] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [234.641095] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.641166] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.641174] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.641370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.641625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.641800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.641923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.642020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.642112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.642200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.642288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.642376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.642458] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.642554] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.642700] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.643739] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.653641] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.653914] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.654888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.654967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.655043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.655120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.655196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.655270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.655344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.655417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.655489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.655565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.655651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.655729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.655804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.655879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.655953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.656028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.656101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.656176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.656252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.656335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.656416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.656494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.656575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.656686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.656765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.656844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.656924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.657006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.657088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.657168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.657248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.657328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.657414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.657499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.657583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.657687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.657767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.657844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.657922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.657999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.658083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.658165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.658245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.658323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.658405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.658484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.658562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.658645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.658726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.658802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.658879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.658959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.659040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.659120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.659198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.659277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.659353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.659429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.659508] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.659622] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.659626] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45930, lrc_seqno=45930, guc_id=0, flags=0x73 in no process [-1] <7> [234.659628] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.660737] ------------[ cut here ]------------ <4> [234.660741] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.660746] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:4/204 <4> [234.660920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.661021] autofs4 [last unloaded: snd_hda_intel] <4> [234.661027] CPU: 12 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.661031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.661033] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.661035] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.661043] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [234.661064] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [234.661157] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.661160] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [234.661163] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.661164] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.661166] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.661168] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.661169] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.661171] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [234.661173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.661174] CR2: 00005c544145a2a0 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [234.661176] PKRU: 55555554 <4> [234.661178] Call Trace: <4> [234.661179] <TASK> <4> [234.661186] ? lock_sync+0x100/0x100 <4> [234.661193] ? lock_release+0xd0/0x2b0 <4> [234.661201] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.661210] process_one_work+0x239/0x760 <4> [234.661225] worker_thread+0x200/0x3f0 <4> [234.661229] ? __pfx_worker_thread+0x10/0x10 <4> [234.661233] kthread+0x10d/0x150 <4> [234.661237] ? __pfx_kthread+0x10/0x10 <4> [234.661243] ret_from_fork+0x3d4/0x480 <4> [234.661245] ? __pfx_kthread+0x10/0x10 <4> [234.661250] ret_from_fork_asm+0x1a/0x30 <4> [234.661263] </TASK> <4> [234.661265] irq event stamp: 681167 <4> [234.661266] hardirqs last enabled at (681173): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.661270] hardirqs last disabled at (681178): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.661274] softirqs last enabled at (680400): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.661277] softirqs last disabled at (680383): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.661280] ---[ end trace 0000000000000000 ]--- <7> [234.661222] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [234.661292] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.661371] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.661379] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.661795] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.662003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.662095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.662189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.662278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.662365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.662452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.662539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.662629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.662733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.662829] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.662947] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.663957] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.674656] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.674906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.675906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.675986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.676064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.676142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.676218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.676294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.676369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.676445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.676522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.676598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.676687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.676761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.676836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.676913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.676990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.677067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.677142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.677216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.677291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.677373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.677454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.677536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.677619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.677718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.677796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.677875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.677952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.678032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.678114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.678197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.678279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.678360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.678450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.678539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.678626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.678725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.678807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.678885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.678964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.679042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.679124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.679207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.679290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.679370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.679453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.679532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.679611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.679700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.679779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.679859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.679942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.680024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.680105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.680184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.680261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.680340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.680417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.680498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.680582] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.680708] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.680713] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45930, lrc_seqno=45930, guc_id=0, flags=0x73 in no process [-1] <7> [234.680715] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.680774] ------------[ cut here ]------------ <4> [234.680775] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.680776] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [234.680849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.680914] autofs4 [last unloaded: snd_hda_intel] <4> [234.680918] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.680921] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.680922] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.680924] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.680929] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.680999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.681001] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.681003] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.681005] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.681006] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.681007] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.681008] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.681010] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [234.681011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.681013] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.681014] PKRU: 55555554 <4> [234.681015] Call Trace: <4> [234.681016] <TASK> <4> [234.681020] ? lock_sync+0x100/0x100 <4> [234.681025] ? lock_release+0xd0/0x2b0 <4> [234.681030] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.681036] process_one_work+0x239/0x760 <4> [234.681042] worker_thread+0x200/0x3f0 <4> [234.681045] ? __pfx_worker_thread+0x10/0x10 <4> [234.681047] kthread+0x10d/0x150 <4> [234.681050] ? __pfx_kthread+0x10/0x10 <4> [234.681054] ret_from_fork+0x3d4/0x480 <4> [234.681056] ? __pfx_kthread+0x10/0x10 <4> [234.681059] ret_from_fork_asm+0x1a/0x30 <4> [234.681067] </TASK> <4> [234.681068] irq event stamp: 587029 <4> [234.681069] hardirqs last enabled at (587035): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.681072] hardirqs last disabled at (587040): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.681074] softirqs last enabled at (586026): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.681076] softirqs last disabled at (586019): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.681078] ---[ end trace 0000000000000000 ]--- <5> [234.681655] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45985, lrc_seqno=45985, guc_id=0, flags=0x73 in no process [-1] <7> [234.681662] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.682016] ------------[ cut here ]------------ <4> [234.682019] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.682022] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:1/120 <4> [234.682307] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.682374] autofs4 [last unloaded: snd_hda_intel] <4> [234.682378] CPU: 3 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.682381] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.682382] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.682383] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.682391] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [234.682407] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [234.682509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.682512] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.682514] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.682516] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.682517] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.682519] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.682521] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.682523] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.682525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.682527] CR2: 0000749c7c084478 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [234.682529] PKRU: 55555554 <4> [234.682531] Call Trace: <4> [234.682532] <TASK> <4> [234.682539] ? lock_sync+0x100/0x100 <4> [234.682546] ? lock_release+0xd0/0x2b0 <4> [234.682555] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.682564] process_one_work+0x239/0x760 <4> [234.682575] worker_thread+0x200/0x3f0 <4> [234.682579] ? __pfx_worker_thread+0x10/0x10 <4> [234.682583] kthread+0x10d/0x150 <4> [234.682586] ? __pfx_kthread+0x10/0x10 <4> [234.682592] ret_from_fork+0x3d4/0x480 <4> [234.682594] ? __pfx_kthread+0x10/0x10 <4> [234.682599] ret_from_fork_asm+0x1a/0x30 <4> [234.682612] </TASK> <4> [234.682614] irq event stamp: 588901 <4> [234.682616] hardirqs last enabled at (588907): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.682619] hardirqs last disabled at (588912): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.682623] softirqs last enabled at (586026): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.682627] softirqs last disabled at (586019): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.682636] ---[ end trace 0000000000000000 ]--- <7> [234.682566] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [234.682639] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.682745] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.682752] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.682959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.683164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.683255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.683348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.683438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.683530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.683619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.683725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.683813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.683896] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.683991] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.684111] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.685122] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.696140] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.696392] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.697430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.697511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.697588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.697679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.697756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.697832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.697908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.697986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.698064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.698141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.698217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.698292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.698367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.698442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.698516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.698591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.698680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.698759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.698836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.698922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.699006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.699087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.699168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.699246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.699321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.699398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.699474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.699553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.699636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.699714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.699793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.699873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.699958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.700047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.700137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.700222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.700305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.700384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.700463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.700541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.700623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.700717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.700797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.700875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.700960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.701042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.701122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.701201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.701280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.701358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.701435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.701516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.701593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.701679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.701758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.701842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.701922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.702002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.702083] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.702198] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.702202] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45985, lrc_seqno=45985, guc_id=0, flags=0x73 in no process [-1] <7> [234.702204] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.702264] ------------[ cut here ]------------ <4> [234.702265] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.702267] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:1/120 <4> [234.702338] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.702402] autofs4 [last unloaded: snd_hda_intel] <4> [234.702406] CPU: 3 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.702409] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.702410] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.702412] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.702417] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.702485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.702487] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.702489] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.702491] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.702492] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.702493] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.702494] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.702496] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [234.702497] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.702499] CR2: 0000749c7c084478 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.702500] PKRU: 55555554 <4> [234.702501] Call Trace: <4> [234.702502] <TASK> <4> [234.702506] ? lock_sync+0x100/0x100 <4> [234.702510] ? lock_release+0xd0/0x2b0 <4> [234.702516] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.702522] process_one_work+0x239/0x760 <4> [234.702527] worker_thread+0x200/0x3f0 <4> [234.702530] ? __pfx_worker_thread+0x10/0x10 <4> [234.702533] kthread+0x10d/0x150 <4> [234.702535] ? __pfx_kthread+0x10/0x10 <4> [234.702539] ret_from_fork+0x3d4/0x480 <4> [234.702541] ? __pfx_kthread+0x10/0x10 <4> [234.702544] ret_from_fork_asm+0x1a/0x30 <4> [234.702552] </TASK> <4> [234.702553] irq event stamp: 592017 <4> [234.702554] hardirqs last enabled at (592023): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.702557] hardirqs last disabled at (592028): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.702559] softirqs last enabled at (591060): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.702561] softirqs last disabled at (591053): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.702564] ---[ end trace 0000000000000000 ]--- <6> [234.702565] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.703657] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.703675] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.703890] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.703996] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.704104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.704309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.704398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.704491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.704578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.704679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.704766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.704850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.704935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.705016] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.705112] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.705228] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.706238] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.716965] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.717216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.718228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.718309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.718386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.718465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.718545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.718626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.718722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.718799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.718876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.718952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.719029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.719105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.719180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.719254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.719330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.719405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.719480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.719557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.719639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.719724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.719809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.719890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.719970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.720048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.720126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.720204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.720282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.720361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.720442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.720521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.720601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.720692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.720781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.720868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.720953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.721036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.721116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.721196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.721273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.721350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.721430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.721508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.721584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.721668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.721748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.721825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.721903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.721980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.722063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.722143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.722224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.722306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.722385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.722463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.722540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.722619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.722707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.722783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.722865] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.722980] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.722984] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=45985, lrc_seqno=45985, guc_id=0, flags=0x73 in no process [-1] <7> [234.722986] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.723046] ------------[ cut here ]------------ <4> [234.723047] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.723049] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [234.723122] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.723187] autofs4 [last unloaded: snd_hda_intel] <4> [234.723191] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.723194] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.723195] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.723197] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.723202] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.723271] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.723272] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.723275] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.723276] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.723277] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.723279] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.723280] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.723281] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [234.723283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.723284] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.723286] PKRU: 55555554 <4> [234.723287] Call Trace: <4> [234.723288] <TASK> <4> [234.723292] ? lock_sync+0x100/0x100 <4> [234.723296] ? lock_release+0xd0/0x2b0 <4> [234.723302] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.723307] process_one_work+0x239/0x760 <4> [234.723313] worker_thread+0x200/0x3f0 <4> [234.723316] ? __pfx_worker_thread+0x10/0x10 <4> [234.723319] kthread+0x10d/0x150 <4> [234.723321] ? __pfx_kthread+0x10/0x10 <4> [234.723325] ret_from_fork+0x3d4/0x480 <4> [234.723327] ? __pfx_kthread+0x10/0x10 <4> [234.723330] ret_from_fork_asm+0x1a/0x30 <4> [234.723338] </TASK> <4> [234.723339] irq event stamp: 595155 <4> [234.723340] hardirqs last enabled at (595161): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.723343] hardirqs last disabled at (595166): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.723345] softirqs last enabled at (594212): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.723348] softirqs last disabled at (594205): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.723350] ---[ end trace 0000000000000000 ]--- <5> [234.724528] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46040, lrc_seqno=46040, guc_id=0, flags=0x73 in no process [-1] <7> [234.724531] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.724596] ------------[ cut here ]------------ <4> [234.724597] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.724598] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [234.724678] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.724744] autofs4 [last unloaded: snd_hda_intel] <4> [234.724748] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.724750] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.724751] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.724753] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.724757] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.724825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.724826] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.724828] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.724830] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.724831] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.724832] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.724834] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.724835] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [234.724836] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.724838] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.724839] PKRU: 55555554 <4> [234.724840] Call Trace: <4> [234.724841] <TASK> <4> [234.724845] ? lock_sync+0x100/0x100 <4> [234.724849] ? lock_release+0xd0/0x2b0 <4> [234.724855] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.724860] process_one_work+0x239/0x760 <4> [234.724866] worker_thread+0x200/0x3f0 <4> [234.724869] ? __pfx_worker_thread+0x10/0x10 <4> [234.724871] kthread+0x10d/0x150 <4> [234.724874] ? __pfx_kthread+0x10/0x10 <4> [234.724878] ret_from_fork+0x3d4/0x480 <4> [234.724880] ? __pfx_kthread+0x10/0x10 <4> [234.724883] ret_from_fork_asm+0x1a/0x30 <4> [234.724890] </TASK> <4> [234.724892] irq event stamp: 597047 <4> [234.724893] hardirqs last enabled at (597053): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.724895] hardirqs last disabled at (597058): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.724897] softirqs last enabled at (594212): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.724900] softirqs last disabled at (594205): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.724902] ---[ end trace 0000000000000000 ]--- <6> [234.724904] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.724972] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.724978] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.725139] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.725241] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.725347] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.725557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.725655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.725752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.725843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.725935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.726023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.726111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.726198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.726280] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.726378] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.726496] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.727505] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.737642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.737892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.738898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.738978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.739054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.739132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.739210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.739288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.739367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.739442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.739517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.739592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.739677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.739751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.739825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.739899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.739973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.740046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.740120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.740194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.740270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.740354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.740436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.740515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.740596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.740689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.740767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.740845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.740925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.741009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.741092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.741173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.741254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.741334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.741417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.741502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.741586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.741676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.741756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.741832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.741908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.741984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.742063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.742144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.742226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.742315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.742399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.742478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.742558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.742642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.742721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.742797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.742873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.742953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.743084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.743188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.743268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.743348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.743425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.743506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.743589] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.743718] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.743723] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46040, lrc_seqno=46040, guc_id=0, flags=0x73 in no process [-1] <7> [234.743725] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.743785] ------------[ cut here ]------------ <4> [234.743786] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.743788] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:3/191 <4> [234.743860] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.743926] autofs4 [last unloaded: snd_hda_intel] <4> [234.743930] CPU: 5 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.743933] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.743934] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.743936] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.743941] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.744012] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.744013] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.744016] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.744017] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.744018] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.744020] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.744021] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.744022] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.744024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.744025] CR2: 0000749c7c085228 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.744027] PKRU: 55555554 <4> [234.744028] Call Trace: <4> [234.744029] <TASK> <4> [234.744033] ? lock_sync+0x100/0x100 <4> [234.744038] ? lock_release+0xd0/0x2b0 <4> [234.744043] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.744049] process_one_work+0x239/0x760 <4> [234.744055] worker_thread+0x200/0x3f0 <4> [234.744058] ? __pfx_worker_thread+0x10/0x10 <4> [234.744060] kthread+0x10d/0x150 <4> [234.744063] ? __pfx_kthread+0x10/0x10 <4> [234.744067] ret_from_fork+0x3d4/0x480 <4> [234.744069] ? __pfx_kthread+0x10/0x10 <4> [234.744072] ret_from_fork_asm+0x1a/0x30 <4> [234.744080] </TASK> <4> [234.744081] irq event stamp: 1362719 <4> [234.744082] hardirqs last enabled at (1362725): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.744085] hardirqs last disabled at (1362730): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.744087] softirqs last enabled at (1361884): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.744089] softirqs last disabled at (1361867): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.744092] ---[ end trace 0000000000000000 ]--- <6> [234.744094] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.744163] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.744170] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.745405] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.745510] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.745617] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.745842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.745934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.746029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.746119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.746206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.746293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.746379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.746466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.746549] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.746655] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.746774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.747781] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.757641] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.757891] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.758857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.758938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.759015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.759092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.759169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.759245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.759319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.759394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.759468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.759542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.759617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.759707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.759784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.759860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.759936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.760010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.760084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.760158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.760232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.760315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.760399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.760480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.760560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.760645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.760723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.760799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.760876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.760957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.761040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.761123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.761204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.761285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.761371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.761455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.761538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.761620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.761719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.761803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.761884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.761962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.762043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.762123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.762201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.762279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.762361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.762439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.762517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.762593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.762684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.762759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.762835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.762915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.762993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.763071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.763148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.763225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.763301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.763377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.763461] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.763575] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.763579] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46040, lrc_seqno=46040, guc_id=0, flags=0x73 in no process [-1] <7> [234.763582] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.763648] ------------[ cut here ]------------ <4> [234.763649] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.763651] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:4/204 <4> [234.763724] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.763789] autofs4 [last unloaded: snd_hda_intel] <4> [234.763793] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.763796] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.763797] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.763798] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.763804] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.763873] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.763875] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [234.763877] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.763879] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.763880] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.763881] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.763883] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.763884] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.763886] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.763887] CR2: 00007dd8c736a008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.763889] PKRU: 55555554 <4> [234.763890] Call Trace: <4> [234.763891] <TASK> <4> [234.763895] ? lock_sync+0x100/0x100 <4> [234.763899] ? lock_release+0xd0/0x2b0 <4> [234.763905] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.763911] process_one_work+0x239/0x760 <4> [234.763917] worker_thread+0x200/0x3f0 <4> [234.763920] ? __pfx_worker_thread+0x10/0x10 <4> [234.763922] kthread+0x10d/0x150 <4> [234.763925] ? __pfx_kthread+0x10/0x10 <4> [234.763929] ret_from_fork+0x3d4/0x480 <4> [234.763931] ? __pfx_kthread+0x10/0x10 <4> [234.763934] ret_from_fork_asm+0x1a/0x30 <4> [234.763941] </TASK> <4> [234.763943] irq event stamp: 686833 <4> [234.763944] hardirqs last enabled at (686839): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.763947] hardirqs last disabled at (686844): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.763949] softirqs last enabled at (685924): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.763951] softirqs last disabled at (685917): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.763954] ---[ end trace 0000000000000000 ]--- <5> [234.765138] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46095, lrc_seqno=46095, guc_id=0, flags=0x73 in no process [-1] <7> [234.765142] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.765211] ------------[ cut here ]------------ <4> [234.765213] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.765214] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:4/204 <4> [234.765284] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.765348] autofs4 [last unloaded: snd_hda_intel] <4> [234.765351] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.765354] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.765355] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.765356] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.765361] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.765430] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.765432] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [234.765434] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.765435] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.765436] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.765437] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.765438] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.765440] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.765441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.765443] CR2: 00007dd8c736a008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.765444] PKRU: 55555554 <4> [234.765445] Call Trace: <4> [234.765446] <TASK> <4> [234.765450] ? lock_sync+0x100/0x100 <4> [234.765454] ? lock_release+0xd0/0x2b0 <4> [234.765459] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.765465] process_one_work+0x239/0x760 <4> [234.765471] worker_thread+0x200/0x3f0 <4> [234.765474] ? __pfx_worker_thread+0x10/0x10 <4> [234.765476] kthread+0x10d/0x150 <4> [234.765479] ? __pfx_kthread+0x10/0x10 <4> [234.765483] ret_from_fork+0x3d4/0x480 <4> [234.765484] ? __pfx_kthread+0x10/0x10 <4> [234.765488] ret_from_fork_asm+0x1a/0x30 <4> [234.765495] </TASK> <4> [234.765496] irq event stamp: 688717 <4> [234.765497] hardirqs last enabled at (688723): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.765500] hardirqs last disabled at (688728): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.765502] softirqs last enabled at (685924): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.765504] softirqs last disabled at (685917): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.765507] ---[ end trace 0000000000000000 ]--- <6> [234.765508] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.765579] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.765585] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.765801] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.765907] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.766015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.766219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.766308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.766401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.766493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.766582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.766684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.766770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.766858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.766940] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.767035] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.767152] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.768160] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.778641] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.778894] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.779922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.780001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.780078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.780155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.780232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.780308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.780384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.780459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.780535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.780610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.780699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.780781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.780860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.780937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.781013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.781087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.781161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.781236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.781310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.781391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.781472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.781554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.781641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.781721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.781800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.781876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.781953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.782032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.782117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.782198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.782280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.782360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.782445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.782529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.782614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.782711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.782792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.782875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.782957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.783037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.783119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.783202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.783285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.783365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.783447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.783526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.783605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.783694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.783775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.783852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.783932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.784016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.784096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.784175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.784254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.784334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.784412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.784489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.784570] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.784689] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.784693] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46095, lrc_seqno=46095, guc_id=0, flags=0x73 in no process [-1] <7> [234.784695] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.784754] ------------[ cut here ]------------ <4> [234.784755] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.784756] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:4/204 <4> [234.784828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.784892] autofs4 [last unloaded: snd_hda_intel] <4> [234.784896] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:4 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.784899] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.784900] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.784901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.784906] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.784976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.784978] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [234.784980] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.784981] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.784983] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.784984] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.784985] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.784986] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.784988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.784989] CR2: 00007dd8c736a008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.784991] PKRU: 55555554 <4> [234.784992] Call Trace: <4> [234.784993] <TASK> <4> [234.784997] ? lock_sync+0x100/0x100 <4> [234.785001] ? lock_release+0xd0/0x2b0 <4> [234.785007] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.785012] process_one_work+0x239/0x760 <4> [234.785019] worker_thread+0x200/0x3f0 <4> [234.785021] ? __pfx_worker_thread+0x10/0x10 <4> [234.785024] kthread+0x10d/0x150 <4> [234.785027] ? __pfx_kthread+0x10/0x10 <4> [234.785030] ret_from_fork+0x3d4/0x480 <4> [234.785032] ? __pfx_kthread+0x10/0x10 <4> [234.785036] ret_from_fork_asm+0x1a/0x30 <4> [234.785043] </TASK> <4> [234.785044] irq event stamp: 691827 <4> [234.785045] hardirqs last enabled at (691833): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.785048] hardirqs last disabled at (691838): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.785050] softirqs last enabled at (690912): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.785053] softirqs last disabled at (690905): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.785055] ---[ end trace 0000000000000000 ]--- <6> [234.785057] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.785128] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.785134] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.786381] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.786487] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.786593] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.786814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.786906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.787000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.787090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.787178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.787263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.787349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.787434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.787517] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.787612] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.787743] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.788753] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.799475] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.799727] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.800740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.800819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.800897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.800977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.801056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.801133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.801209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.801284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.801359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.801432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.801507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.801582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.801669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.801747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.801823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.801899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.801974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.802049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.802123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.802206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.802286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.802367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.802450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.802531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.802610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.802698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.802776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.802855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.802936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.803014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.803093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.803172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.803259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.803347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.803434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.803516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.803601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.803693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.803775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.803854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.803937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.804017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.804099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.804180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.804263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.804342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.804419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.804498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.804577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.804661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.804739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.804825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.804906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.804985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.805062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.805141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.805218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.805296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.805385] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.805498] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.805502] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46095, lrc_seqno=46095, guc_id=0, flags=0x73 in no process [-1] <7> [234.805504] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.805563] ------------[ cut here ]------------ <4> [234.805564] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.805566] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:3/191 <4> [234.805643] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.805710] autofs4 [last unloaded: snd_hda_intel] <4> [234.805714] CPU: 5 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.805717] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.805718] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.805719] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.805725] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.805794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.805796] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.805798] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.805800] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.805801] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.805802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.805804] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.805805] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.805807] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.805808] CR2: 0000749c7c085228 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.805810] PKRU: 55555554 <4> [234.805811] Call Trace: <4> [234.805812] <TASK> <4> [234.805816] ? lock_sync+0x100/0x100 <4> [234.805821] ? lock_release+0xd0/0x2b0 <4> [234.805827] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.805832] process_one_work+0x239/0x760 <4> [234.805839] worker_thread+0x200/0x3f0 <4> [234.805842] ? __pfx_worker_thread+0x10/0x10 <4> [234.805844] kthread+0x10d/0x150 <4> [234.805847] ? __pfx_kthread+0x10/0x10 <4> [234.805850] ret_from_fork+0x3d4/0x480 <4> [234.805852] ? __pfx_kthread+0x10/0x10 <4> [234.805856] ret_from_fork_asm+0x1a/0x30 <4> [234.805863] </TASK> <4> [234.805864] irq event stamp: 1366283 <4> [234.805865] hardirqs last enabled at (1366289): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.805868] hardirqs last disabled at (1366294): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.805871] softirqs last enabled at (1365380): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.805873] softirqs last disabled at (1365373): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.805875] ---[ end trace 0000000000000000 ]--- <5> [234.807093] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46150, lrc_seqno=46150, guc_id=0, flags=0x73 in no process [-1] <7> [234.807096] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.807158] ------------[ cut here ]------------ <4> [234.807159] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.807161] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:3/191 <4> [234.807230] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.807295] autofs4 [last unloaded: snd_hda_intel] <4> [234.807299] CPU: 5 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.807301] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.807302] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.807303] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.807308] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.807378] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.807379] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.807381] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.807382] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.807384] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.807385] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.807386] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.807387] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.807389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.807390] CR2: 0000749c7c085228 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.807391] PKRU: 55555554 <4> [234.807393] Call Trace: <4> [234.807394] <TASK> <4> [234.807397] ? lock_sync+0x100/0x100 <4> [234.807402] ? lock_release+0xd0/0x2b0 <4> [234.807407] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.807412] process_one_work+0x239/0x760 <4> [234.807418] worker_thread+0x200/0x3f0 <4> [234.807421] ? __pfx_worker_thread+0x10/0x10 <4> [234.807424] kthread+0x10d/0x150 <4> [234.807427] ? __pfx_kthread+0x10/0x10 <4> [234.807431] ret_from_fork+0x3d4/0x480 <4> [234.807433] ? __pfx_kthread+0x10/0x10 <4> [234.807436] ret_from_fork_asm+0x1a/0x30 <4> [234.807443] </TASK> <4> [234.807445] irq event stamp: 1368141 <4> [234.807446] hardirqs last enabled at (1368147): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.807448] hardirqs last disabled at (1368152): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.807450] softirqs last enabled at (1365380): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.807453] softirqs last disabled at (1365373): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.807455] ---[ end trace 0000000000000000 ]--- <6> [234.807457] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.807526] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.807531] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.808018] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.808123] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.808230] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.808436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.808526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.808620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.808726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.808812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.808897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.808982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.809070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.809158] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.809254] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.809373] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.810391] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.820992] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.821242] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.822276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.822357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.822435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.822514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.822590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.822677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.822753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.822828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.822903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.822977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.823051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.823125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.823199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.823276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.823353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.823429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.823505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.823579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.823662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.823744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.823824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.823903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.823984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.824064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.824144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.824222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.824300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.824381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.824461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.824539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.824618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.824708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.824797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.824883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.824967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.825048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.825130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.825207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.825286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.825365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.825446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.825526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.825604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.825691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.825773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.825850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.825930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.826011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.826092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.826172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.826249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.826333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.826415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.826496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.826574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.826658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.826738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.826816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.826897] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.827011] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.827015] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46150, lrc_seqno=46150, guc_id=0, flags=0x73 in no process [-1] <7> [234.827017] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.827075] ------------[ cut here ]------------ <4> [234.827076] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.827078] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [234.827148] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.827214] autofs4 [last unloaded: snd_hda_intel] <4> [234.827218] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.827221] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.827222] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.827224] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.827230] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.827300] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.827301] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.827304] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.827305] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.827306] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.827307] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.827309] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.827310] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.827312] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.827313] CR2: 0000749c879c2000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.827315] PKRU: 55555554 <4> [234.827316] Call Trace: <4> [234.827317] <TASK> <4> [234.827321] ? lock_sync+0x100/0x100 <4> [234.827326] ? lock_release+0xd0/0x2b0 <4> [234.827331] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.827337] process_one_work+0x239/0x760 <4> [234.827343] worker_thread+0x200/0x3f0 <4> [234.827346] ? __pfx_worker_thread+0x10/0x10 <4> [234.827348] kthread+0x10d/0x150 <4> [234.827351] ? __pfx_kthread+0x10/0x10 <4> [234.827355] ret_from_fork+0x3d4/0x480 <4> [234.827357] ? __pfx_kthread+0x10/0x10 <4> [234.827360] ret_from_fork_asm+0x1a/0x30 <4> [234.827367] </TASK> <4> [234.827368] irq event stamp: 1371265 <4> [234.827369] hardirqs last enabled at (1371271): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.827372] hardirqs last disabled at (1371276): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.827374] softirqs last enabled at (1370224): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.827377] softirqs last disabled at (1370217): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.827379] ---[ end trace 0000000000000000 ]--- <6> [234.827381] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.827451] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.827457] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.828691] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.828797] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.828901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.829110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.829203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.829300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.829391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.829481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.829569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.829658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.829746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.829829] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.829925] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.830042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.831053] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.841776] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.842027] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.843021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.843100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.843177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.843254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.843331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.843408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.843487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.843565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.843646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.843721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.843796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.843870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.843943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.844017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.844091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.844164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.844237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.844311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.844385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.844467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.844549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.844631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.844728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.844809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.844887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.844966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.845043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.845122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.845202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.845280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.845359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.845437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.845521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.845609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.845705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.845789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.845869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.845948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.846026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.846102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.846182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.846261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.846342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.846421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.846503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.846581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.846663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.846740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.846823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.846902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.846979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.847060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.847138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.847216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.847293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.847371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.847447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.847523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.847603] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.847726] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.847730] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46150, lrc_seqno=46150, guc_id=0, flags=0x73 in no process [-1] <7> [234.847733] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.847791] ------------[ cut here ]------------ <4> [234.847793] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.847794] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [234.847867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.847935] autofs4 [last unloaded: snd_hda_intel] <4> [234.847940] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.847943] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.847944] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.847946] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.847951] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.848022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.848024] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.848026] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.848028] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.848030] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.848031] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.848033] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.848034] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [234.848036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.848038] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.848039] PKRU: 55555554 <4> [234.848040] Call Trace: <4> [234.848042] <TASK> <4> [234.848046] ? lock_sync+0x100/0x100 <4> [234.848050] ? lock_release+0xd0/0x2b0 <4> [234.848056] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.848061] process_one_work+0x239/0x760 <4> [234.848068] worker_thread+0x200/0x3f0 <4> [234.848070] ? __pfx_worker_thread+0x10/0x10 <4> [234.848073] kthread+0x10d/0x150 <4> [234.848076] ? __pfx_kthread+0x10/0x10 <4> [234.848080] ret_from_fork+0x3d4/0x480 <4> [234.848082] ? __pfx_kthread+0x10/0x10 <4> [234.848085] ret_from_fork_asm+0x1a/0x30 <4> [234.848092] </TASK> <4> [234.848094] irq event stamp: 604165 <4> [234.848095] hardirqs last enabled at (604171): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.848098] hardirqs last disabled at (604176): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.848100] softirqs last enabled at (603152): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.848102] softirqs last disabled at (603143): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.848105] ---[ end trace 0000000000000000 ]--- <5> [234.848466] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46205, lrc_seqno=46205, guc_id=0, flags=0x73 in no process [-1] <7> [234.848471] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.848594] ------------[ cut here ]------------ <4> [234.848596] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.848598] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:3/191 <4> [234.848690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.848768] autofs4 [last unloaded: snd_hda_intel] <4> [234.848774] CPU: 10 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.848778] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.848779] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.848781] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.848789] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.848874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.848876] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.848878] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.848880] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.848882] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.848883] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.848884] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.848885] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.848887] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.848888] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [234.848890] PKRU: 55555554 <4> [234.848891] Call Trace: <4> [234.848892] <TASK> <4> [234.848896] ? lock_sync+0x100/0x100 <4> [234.848902] ? lock_release+0xd0/0x2b0 <4> [234.848907] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.848913] process_one_work+0x239/0x760 <4> [234.848919] worker_thread+0x200/0x3f0 <4> [234.848922] ? __pfx_worker_thread+0x10/0x10 <4> [234.848925] kthread+0x10d/0x150 <4> [234.848928] ? __pfx_kthread+0x10/0x10 <4> [234.848932] ret_from_fork+0x3d4/0x480 <4> [234.848935] ? __pfx_kthread+0x10/0x10 <4> [234.848938] ret_from_fork_asm+0x1a/0x30 <4> [234.848947] </TASK> <4> [234.848948] irq event stamp: 1372499 <4> [234.848949] hardirqs last enabled at (1372505): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.848952] hardirqs last disabled at (1372510): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.848955] softirqs last enabled at (1371484): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [234.848957] softirqs last disabled at (1371482): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [234.848960] ---[ end trace 0000000000000000 ]--- <6> [234.848962] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.849047] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.849386] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.849442] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.849548] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.849657] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.849860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.849949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.850044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.850134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.850220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.850306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.850392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.850479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.850561] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.850659] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.850777] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.851784] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.861642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.861892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.862886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.862965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.863044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.863120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.863197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.863273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.863348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.863424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.863500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.863576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.863658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.863736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.863813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.863890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.863965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.864041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.864115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.864190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.864264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.864350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.864434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.864515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.864597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.864684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.864766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.864848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.864928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.865009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.865092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.865172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.865253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.865333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.865419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.865503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.865587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.865676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.865761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.865841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.865920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.865998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.866079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.866156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.866233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.866309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.866389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.866465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.866547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.866625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.866716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.866793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.866871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.866950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.867028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.867106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.867182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.867260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.867335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.867411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.867491] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.867601] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.867605] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46205, lrc_seqno=46205, guc_id=0, flags=0x73 in no process [-1] <7> [234.867607] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.868535] ------------[ cut here ]------------ <4> [234.868536] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.868538] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [234.868611] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.868682] autofs4 [last unloaded: snd_hda_intel] <4> [234.868686] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.868689] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.868690] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.868691] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.868697] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.868767] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.868768] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.868771] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.868772] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.868773] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.868775] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.868776] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.868777] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [234.868779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.868780] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.868782] PKRU: 55555554 <4> [234.868783] Call Trace: <4> [234.868784] <TASK> <4> [234.868788] ? lock_sync+0x100/0x100 <4> [234.868792] ? lock_release+0xd0/0x2b0 <4> [234.868798] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.868804] process_one_work+0x239/0x760 <4> [234.868810] worker_thread+0x200/0x3f0 <4> [234.868813] ? __pfx_worker_thread+0x10/0x10 <4> [234.868815] kthread+0x10d/0x150 <4> [234.868818] ? __pfx_kthread+0x10/0x10 <4> [234.868822] ret_from_fork+0x3d4/0x480 <4> [234.868824] ? __pfx_kthread+0x10/0x10 <4> [234.868827] ret_from_fork_asm+0x1a/0x30 <4> [234.868835] </TASK> <4> [234.868836] irq event stamp: 608435 <4> [234.868837] hardirqs last enabled at (608441): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.868840] hardirqs last disabled at (608446): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.868842] softirqs last enabled at (607668): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.868845] softirqs last disabled at (607645): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.868847] ---[ end trace 0000000000000000 ]--- <6> [234.868849] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.868919] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.868925] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.868940] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.869043] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.869333] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.869538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.869629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.869742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.869832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.869921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.870008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.870093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.870180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.870262] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.870358] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.870475] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.871484] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.881642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.881891] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.882880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.882960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.883038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.883117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.883196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.883275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.883352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.883428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.883504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.883577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.883658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.883733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.883808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.883882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.883955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.884029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.884102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.884175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.884249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.884329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.884411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.884493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.884575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.884656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.884733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.884810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.884885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.884964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.885043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.885122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.885200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.885278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.885363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.885452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.885540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.885623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.885716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.885795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.885873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.885950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.886031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.886110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.886188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.886265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.886344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.886421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.886497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.886577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.886664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.886744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.886822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.886901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.886978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.887055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.887135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.887216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.887292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.887369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.887451] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.887565] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.887569] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46205, lrc_seqno=46205, guc_id=0, flags=0x73 in no process [-1] <7> [234.887571] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.887630] ------------[ cut here ]------------ <4> [234.887631] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.887632] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:3/191 <4> [234.887723] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.887791] autofs4 [last unloaded: snd_hda_intel] <4> [234.887795] CPU: 10 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.887797] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.887799] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.887800] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.887805] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.887874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.887876] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.887878] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.887880] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.887881] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.887882] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.887883] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.887885] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.887886] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.887888] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [234.887889] PKRU: 55555554 <4> [234.887891] Call Trace: <4> [234.887892] <TASK> <4> [234.887896] ? lock_sync+0x100/0x100 <4> [234.887900] ? lock_release+0xd0/0x2b0 <4> [234.887906] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.887912] process_one_work+0x239/0x760 <4> [234.887918] worker_thread+0x200/0x3f0 <4> [234.887921] ? __pfx_worker_thread+0x10/0x10 <4> [234.887923] kthread+0x10d/0x150 <4> [234.887926] ? __pfx_kthread+0x10/0x10 <4> [234.887930] ret_from_fork+0x3d4/0x480 <4> [234.887932] ? __pfx_kthread+0x10/0x10 <4> [234.887935] ret_from_fork_asm+0x1a/0x30 <4> [234.887943] </TASK> <4> [234.887944] irq event stamp: 1375819 <4> [234.887945] hardirqs last enabled at (1375825): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.887948] hardirqs last disabled at (1375830): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.887950] softirqs last enabled at (1375076): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.887953] softirqs last disabled at (1375059): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.887955] ---[ end trace 0000000000000000 ]--- <7> [234.888979] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.889087] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [234.889290] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46260, lrc_seqno=46260, guc_id=0, flags=0x73 in no process [-1] <7> [234.889293] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.889353] ------------[ cut here ]------------ <4> [234.889354] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.889355] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [234.889425] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.889489] autofs4 [last unloaded: snd_hda_intel] <4> [234.889493] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.889495] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.889496] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.889498] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.889503] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.889571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.889573] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [234.889575] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.889576] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.889578] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.889579] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.889580] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.889581] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [234.889583] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.889584] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.889585] PKRU: 55555554 <4> [234.889586] Call Trace: <4> [234.889587] <TASK> <4> [234.889591] ? lock_sync+0x100/0x100 <4> [234.889595] ? lock_release+0xd0/0x2b0 <4> [234.889601] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.889606] process_one_work+0x239/0x760 <4> [234.889613] worker_thread+0x200/0x3f0 <4> [234.889615] ? __pfx_worker_thread+0x10/0x10 <4> [234.889618] kthread+0x10d/0x150 <4> [234.889621] ? __pfx_kthread+0x10/0x10 <4> [234.889624] ret_from_fork+0x3d4/0x480 <4> [234.889626] ? __pfx_kthread+0x10/0x10 <4> [234.889630] ret_from_fork_asm+0x1a/0x30 <4> [234.889642] </TASK> <4> [234.889644] irq event stamp: 610291 <4> [234.889645] hardirqs last enabled at (610297): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.889648] hardirqs last disabled at (610302): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.889650] softirqs last enabled at (610284): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.889653] softirqs last disabled at (610277): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.889655] ---[ end trace 0000000000000000 ]--- <6> [234.889657] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.889727] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.889734] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.889861] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.890070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.890162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.890260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.890350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.890437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.890526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.890617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.890723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.890811] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.890908] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.891026] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.892037] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.902761] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.903013] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.904044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.904125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.904203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.904282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.904359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.904436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.904510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.904585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.904667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.904743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.904817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.904892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.904967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.905042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.905115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.905189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.905263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.905338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.905417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.905500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.905582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.905668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.905749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.905830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.905910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.905990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.906067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.906147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.906228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.906309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.906393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.906476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.906562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.906650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.906736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.906822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.906905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.906984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.907064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.907143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.907229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.907310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.907388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.907464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.907545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.907622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.907711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.907789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.907870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.907948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.908027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.908107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.908185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.908263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.908339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.908417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.908493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.908569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.908651] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.908768] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.908772] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46260, lrc_seqno=46260, guc_id=0, flags=0x73 in no process [-1] <7> [234.908774] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.908833] ------------[ cut here ]------------ <4> [234.908834] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.908836] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [234.908909] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.908974] autofs4 [last unloaded: snd_hda_intel] <4> [234.908978] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.908981] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.908983] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.908984] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.908989] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.909060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.909062] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.909064] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.909066] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.909067] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.909068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.909069] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.909071] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.909072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.909074] CR2: 0000749c879c2000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.909075] PKRU: 55555554 <4> [234.909076] Call Trace: <4> [234.909078] <TASK> <4> [234.909082] ? lock_sync+0x100/0x100 <4> [234.909086] ? lock_release+0xd0/0x2b0 <4> [234.909092] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.909097] process_one_work+0x239/0x760 <4> [234.909104] worker_thread+0x200/0x3f0 <4> [234.909106] ? __pfx_worker_thread+0x10/0x10 <4> [234.909109] kthread+0x10d/0x150 <4> [234.909112] ? __pfx_kthread+0x10/0x10 <4> [234.909115] ret_from_fork+0x3d4/0x480 <4> [234.909117] ? __pfx_kthread+0x10/0x10 <4> [234.909121] ret_from_fork_asm+0x1a/0x30 <4> [234.909128] </TASK> <4> [234.909129] irq event stamp: 1379351 <4> [234.909130] hardirqs last enabled at (1379357): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.909133] hardirqs last disabled at (1379362): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.909135] softirqs last enabled at (1378430): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.909138] softirqs last disabled at (1378423): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.909140] ---[ end trace 0000000000000000 ]--- <6> [234.909142] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.909212] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.909218] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.909621] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.909843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.909932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.910024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.910115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.910203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.910290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.910377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.910466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.910552] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.910655] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.910773] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.911778] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.922499] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.922750] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.923789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.923869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.923948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.924026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.924103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.924178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.924252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.924328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.924405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.924484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.924562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.924641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.924717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.924792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.924867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.924941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.925016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.925090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.925164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.925247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.925328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.925408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.925489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.925569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.925653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.925737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.925818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.925899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.925980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.926060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.926141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.926219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.926303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.926388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.926472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.926553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.926632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.926726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.926807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.926888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.926971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.927050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.927128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.927205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.927288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.927366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.927445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.927522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.927601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.927685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.927761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.927841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.927922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.928006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.928086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.928167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.928245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.928321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.928402] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.928516] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.928520] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46260, lrc_seqno=46260, guc_id=0, flags=0x73 in no process [-1] <7> [234.928522] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.928581] ------------[ cut here ]------------ <4> [234.928582] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.928584] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [234.928662] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.928728] autofs4 [last unloaded: snd_hda_intel] <4> [234.928731] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.928734] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.928735] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.928737] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.928742] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.928812] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.928813] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.928815] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.928817] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.928818] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.928819] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.928820] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.928822] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.928823] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.928825] CR2: 0000749c879c2000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.928826] PKRU: 55555554 <4> [234.928827] Call Trace: <4> [234.928828] <TASK> <4> [234.928832] ? lock_sync+0x100/0x100 <4> [234.928836] ? lock_release+0xd0/0x2b0 <4> [234.928842] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.928848] process_one_work+0x239/0x760 <4> [234.928854] worker_thread+0x200/0x3f0 <4> [234.928856] ? __pfx_worker_thread+0x10/0x10 <4> [234.928859] kthread+0x10d/0x150 <4> [234.928862] ? __pfx_kthread+0x10/0x10 <4> [234.928865] ret_from_fork+0x3d4/0x480 <4> [234.928867] ? __pfx_kthread+0x10/0x10 <4> [234.928871] ret_from_fork_asm+0x1a/0x30 <4> [234.928878] </TASK> <4> [234.928879] irq event stamp: 1382453 <4> [234.928880] hardirqs last enabled at (1382459): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.928883] hardirqs last disabled at (1382464): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.928885] softirqs last enabled at (1381466): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.928888] softirqs last disabled at (1381457): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.928890] ---[ end trace 0000000000000000 ]--- <5> [234.930274] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46315, lrc_seqno=46315, guc_id=0, flags=0x73 in no process [-1] <7> [234.930279] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [234.930284] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [234.930382] ------------[ cut here ]------------ <4> [234.930383] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.930385] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:3/191 <4> [234.930503] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc <7> [234.930443] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [234.930515] xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [234.930610] CPU: 5 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.930613] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.930614] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.930615] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.930620] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.930712] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.930714] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [234.930716] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.930718] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.930719] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.930720] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.930721] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.930723] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.930724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.930726] CR2: 0000749c7c085228 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.930727] PKRU: 55555554 <4> [234.930728] Call Trace: <4> [234.930730] <TASK> <4> [234.930734] ? lock_sync+0x100/0x100 <4> [234.930738] ? lock_release+0xd0/0x2b0 <4> [234.930744] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.930750] process_one_work+0x239/0x760 <4> [234.930756] worker_thread+0x200/0x3f0 <4> [234.930758] ? __pfx_worker_thread+0x10/0x10 <4> [234.930761] kthread+0x10d/0x150 <4> [234.930764] ? __pfx_kthread+0x10/0x10 <4> [234.930767] ret_from_fork+0x3d4/0x480 <4> [234.930770] ? __pfx_kthread+0x10/0x10 <4> [234.930773] ret_from_fork_asm+0x1a/0x30 <4> [234.930781] </TASK> <4> [234.930782] irq event stamp: 1384335 <4> [234.930783] hardirqs last enabled at (1384341): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.930786] hardirqs last disabled at (1384346): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.930788] softirqs last enabled at (1384174): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.930791] softirqs last disabled at (1384167): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.930793] ---[ end trace 0000000000000000 ]--- <6> [234.930795] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.930866] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.930874] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.931085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.931295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.931389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.931484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.931572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.931664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.931751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.931838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.931925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.932008] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.932106] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.932223] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.933232] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.943643] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.943896] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.944913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.944995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.945074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.945152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.945229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.945305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.945380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.945455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.945530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.945604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.945694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.945772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.945850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.945926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.946001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.946076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.946151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.946227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.946302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.946385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.946467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.946548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.946631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.946725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.946804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.946883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.946959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.947039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.947121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.947200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.947278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.947357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.947442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.947533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.947621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.947715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.947797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.947877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.947956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.948034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.948114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.948193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.948272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.948354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.948437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.948514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.948594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.948678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.948756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.948832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.948910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.948992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.949071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.949151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.949229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.949307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.949383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.949458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.949538] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.949659] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.949664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46315, lrc_seqno=46315, guc_id=0, flags=0x73 in no process [-1] <7> [234.949667] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.949727] ------------[ cut here ]------------ <4> [234.949729] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.949730] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/2392 <4> [234.949803] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.949869] autofs4 [last unloaded: snd_hda_intel] <4> [234.949873] CPU: 6 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.949876] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.949877] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.949878] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.949884] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.949955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.949956] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [234.949959] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.949960] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.949961] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.949963] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.949964] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.949965] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.949967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.949968] CR2: 00007dd8c736e008 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [234.949970] PKRU: 55555554 <4> [234.949971] Call Trace: <4> [234.949972] <TASK> <4> [234.949976] ? lock_sync+0x100/0x100 <4> [234.949981] ? lock_release+0xd0/0x2b0 <4> [234.949986] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.949992] process_one_work+0x239/0x760 <4> [234.949998] worker_thread+0x200/0x3f0 <4> [234.950001] ? __pfx_worker_thread+0x10/0x10 <4> [234.950003] kthread+0x10d/0x150 <4> [234.950006] ? __pfx_kthread+0x10/0x10 <4> [234.950010] ret_from_fork+0x3d4/0x480 <4> [234.950012] ? __pfx_kthread+0x10/0x10 <4> [234.950015] ret_from_fork_asm+0x1a/0x30 <4> [234.950022] </TASK> <4> [234.950024] irq event stamp: 152057 <4> [234.950025] hardirqs last enabled at (152063): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.950028] hardirqs last disabled at (152068): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.950030] softirqs last enabled at (151256): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.950032] softirqs last disabled at (151245): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.950035] ---[ end trace 0000000000000000 ]--- <6> [234.950036] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.950106] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.950111] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.950499] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.950705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.950794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.950887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.950976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.951064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.951150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.951239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.951330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.951417] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.951513] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.951629] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.952649] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.963371] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.963622] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.964662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.964741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.964817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.964895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.964973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.965050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.965126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.965202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.965278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.965354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.965430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.965508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.965584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.965666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.965741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.965815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.965890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.965964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.966038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.966122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.966203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.966283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.966363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.966440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.966516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.966597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.966685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.966766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.966850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.966933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.967014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.967095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.967182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.967267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.967351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.967432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.967511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.967589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.967676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.967758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.967840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.967919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.967996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.968072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.968152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.968229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.968306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.968381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.968458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.968533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.968608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.968695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.968772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.968849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.968929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.969009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.969086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.969164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.969244] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.969356] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.969360] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46315, lrc_seqno=46315, guc_id=0, flags=0x73 in no process [-1] <7> [234.969362] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.969421] ------------[ cut here ]------------ <4> [234.969422] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.969424] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/2392 <4> [234.969494] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.969557] autofs4 [last unloaded: snd_hda_intel] <4> [234.969561] CPU: 6 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.969564] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.969565] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.969566] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.969571] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.969643] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.969645] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [234.969647] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.969649] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.969650] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.969652] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.969653] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.969654] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.969656] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.969658] CR2: 00007dd8c736e008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.969659] PKRU: 55555554 <4> [234.969660] Call Trace: <4> [234.969661] <TASK> <4> [234.969665] ? lock_sync+0x100/0x100 <4> [234.969669] ? lock_release+0xd0/0x2b0 <4> [234.969675] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.969681] process_one_work+0x239/0x760 <4> [234.969687] worker_thread+0x200/0x3f0 <4> [234.969690] ? __pfx_worker_thread+0x10/0x10 <4> [234.969692] kthread+0x10d/0x150 <4> [234.969695] ? __pfx_kthread+0x10/0x10 <4> [234.969699] ret_from_fork+0x3d4/0x480 <4> [234.969701] ? __pfx_kthread+0x10/0x10 <4> [234.969704] ret_from_fork_asm+0x1a/0x30 <4> [234.969712] </TASK> <4> [234.969713] irq event stamp: 155177 <4> [234.969714] hardirqs last enabled at (155183): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.969717] hardirqs last disabled at (155188): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.969719] softirqs last enabled at (154286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.969721] softirqs last disabled at (154275): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.969724] ---[ end trace 0000000000000000 ]--- <7> [234.971006] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.971117] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [234.971216] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46370, lrc_seqno=46370, guc_id=0, flags=0x73 in no process [-1] <7> [234.971219] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.971279] ------------[ cut here ]------------ <4> [234.971280] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.971281] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/2392 <4> [234.971354] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.971418] autofs4 [last unloaded: snd_hda_intel] <4> [234.971422] CPU: 6 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.971424] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.971425] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.971427] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.971432] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.971502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.971503] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [234.971505] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.971506] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.971508] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.971509] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.971510] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.971511] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.971513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.971514] CR2: 00007dd8c736e008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.971516] PKRU: 55555554 <4> [234.971517] Call Trace: <4> [234.971518] <TASK> <4> [234.971522] ? lock_sync+0x100/0x100 <4> [234.971526] ? lock_release+0xd0/0x2b0 <4> [234.971531] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.971536] process_one_work+0x239/0x760 <4> [234.971542] worker_thread+0x200/0x3f0 <4> [234.971545] ? __pfx_worker_thread+0x10/0x10 <4> [234.971547] kthread+0x10d/0x150 <4> [234.971550] ? __pfx_kthread+0x10/0x10 <4> [234.971554] ret_from_fork+0x3d4/0x480 <4> [234.971556] ? __pfx_kthread+0x10/0x10 <4> [234.971559] ret_from_fork_asm+0x1a/0x30 <4> [234.971566] </TASK> <4> [234.971567] irq event stamp: 157049 <4> [234.971568] hardirqs last enabled at (157055): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.971571] hardirqs last disabled at (157060): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.971573] softirqs last enabled at (154286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.971576] softirqs last disabled at (154275): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.971578] ---[ end trace 0000000000000000 ]--- <6> [234.971579] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.971652] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.971658] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.971905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.972107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.972196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.972290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.972380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.972468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.972555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.972647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.972735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.972818] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.972915] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.973034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.974043] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.984643] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.984893] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.985932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.986012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.986089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.986167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.986245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.986324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.986402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.986479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.986554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.986629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.986722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.986796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.986871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.986946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.987020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.987095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.987170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.987244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.987319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.987404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.987486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.987566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.987650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.987727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.987805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.987882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.987958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.988041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.988124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.988205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.988285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.988365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.988451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.988536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.988621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.988712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.988792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.988869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.988946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.989023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.989102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.989180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.989257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.989333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.989415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.989491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.989572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.989657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.989738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.989816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.989893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.989974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.990053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.990134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.990214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.990295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.990376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.990459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.990541] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.990658] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.990662] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46370, lrc_seqno=46370, guc_id=0, flags=0x73 in no process [-1] <7> [234.990664] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.990723] ------------[ cut here ]------------ <4> [234.990724] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.990725] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/2392 <4> [234.990796] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [234.990861] autofs4 [last unloaded: snd_hda_intel] <4> [234.990865] CPU: 6 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [234.990867] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [234.990869] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.990870] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.990875] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.990946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.990948] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [234.990950] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.990951] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [234.990953] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.990954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.990955] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [234.990956] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.990958] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.990959] CR2: 00007dd8c736e008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.990961] PKRU: 55555554 <4> [234.990962] Call Trace: <4> [234.990963] <TASK> <4> [234.990967] ? lock_sync+0x100/0x100 <4> [234.990971] ? lock_release+0xd0/0x2b0 <4> [234.990976] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.990982] process_one_work+0x239/0x760 <4> [234.990988] worker_thread+0x200/0x3f0 <4> [234.990991] ? __pfx_worker_thread+0x10/0x10 <4> [234.990993] kthread+0x10d/0x150 <4> [234.990996] ? __pfx_kthread+0x10/0x10 <4> [234.991000] ret_from_fork+0x3d4/0x480 <4> [234.991002] ? __pfx_kthread+0x10/0x10 <4> [234.991005] ret_from_fork_asm+0x1a/0x30 <4> [234.991012] </TASK> <4> [234.991013] irq event stamp: 160159 <4> [234.991014] hardirqs last enabled at (160165): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [234.991017] hardirqs last disabled at (160170): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [234.991020] softirqs last enabled at (159358): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.991022] softirqs last disabled at (159351): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.991024] ---[ end trace 0000000000000000 ]--- <6> [234.991026] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.991096] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.991102] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.992343] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.992453] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.992560] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.992780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.992872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.992966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.993058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.993151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.993240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.993327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.993414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.993497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.993593] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.993730] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.994751] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.005476] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.005731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.006776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.006856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.006934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.007013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.007090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.007166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.007242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.007318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.007394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.007470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.007548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.007624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.007717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.007802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.007878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.007953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.008029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.008103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.008178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.008261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.008343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.008425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.008510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.008591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.008684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.008772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.008850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.008930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.009010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.009090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.009174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.009254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.009340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.009424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.009509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.009590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.009683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.009773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.009855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.009936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.010017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.010096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.010176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.010258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.010342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.010422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.010501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.010579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.010666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.010757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.010839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.010921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.011001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.011079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.011156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.011234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.011311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.011389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.011473] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.011586] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.011591] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46370, lrc_seqno=46370, guc_id=0, flags=0x73 in no process [-1] <7> [235.011593] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.011668] ------------[ cut here ]------------ <4> [235.011671] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.011673] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:3/191 <4> [235.011756] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.011822] autofs4 [last unloaded: snd_hda_intel] <4> [235.011826] CPU: 5 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.011829] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.011830] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.011831] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.011837] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.011907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.011909] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.011911] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.011913] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.011914] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.011915] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.011916] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.011918] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [235.011919] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.011921] CR2: 0000749c7c085228 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.011922] PKRU: 55555554 <4> [235.011923] Call Trace: <4> [235.011924] <TASK> <4> [235.011928] ? lock_sync+0x100/0x100 <4> [235.011933] ? lock_release+0xd0/0x2b0 <4> [235.011938] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.011944] process_one_work+0x239/0x760 <4> [235.011950] worker_thread+0x200/0x3f0 <4> [235.011953] ? __pfx_worker_thread+0x10/0x10 <4> [235.011956] kthread+0x10d/0x150 <4> [235.011959] ? __pfx_kthread+0x10/0x10 <4> [235.011962] ret_from_fork+0x3d4/0x480 <4> [235.011964] ? __pfx_kthread+0x10/0x10 <4> [235.011968] ret_from_fork_asm+0x1a/0x30 <4> [235.011975] </TASK> <4> [235.011976] irq event stamp: 1389451 <4> [235.011978] hardirqs last enabled at (1389457): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.011981] hardirqs last disabled at (1389462): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.011983] softirqs last enabled at (1388690): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.011985] softirqs last disabled at (1388683): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.011988] ---[ end trace 0000000000000000 ]--- <5> [235.012664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46425, lrc_seqno=46425, guc_id=0, flags=0x73 in no process [-1] <7> [235.012675] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.013043] ------------[ cut here ]------------ <4> [235.013046] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.013050] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.013226] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.013305] autofs4 [last unloaded: snd_hda_intel] <4> [235.013311] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.013315] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.013317] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.013319] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [235.013298] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [235.013326] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.013439] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.013442] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.013445] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.013447] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.013451] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.013454] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.013456] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.013458] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.013460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.013463] CR2: 0000749c879c7000 CR3: 0000000122e3e003 CR4: 0000000000f72ef0 <4> [235.013465] PKRU: 55555554 <4> [235.013467] Call Trace: <4> [235.013468] <TASK> <4> [235.013474] ? lock_sync+0x100/0x100 <4> [235.013481] ? lock_release+0xd0/0x2b0 <4> [235.013488] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.013499] process_one_work+0x239/0x760 <4> [235.013509] worker_thread+0x200/0x3f0 <4> [235.013514] ? __pfx_worker_thread+0x10/0x10 <4> [235.013518] kthread+0x10d/0x150 <7> [235.013454] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [235.013522] ? __pfx_kthread+0x10/0x10 <4> [235.013528] ret_from_fork+0x3d4/0x480 <4> [235.013530] ? __pfx_kthread+0x10/0x10 <4> [235.013535] ret_from_fork_asm+0x1a/0x30 <4> [235.013546] </TASK> <4> [235.013547] irq event stamp: 1391345 <4> [235.013549] hardirqs last enabled at (1391351): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.013552] hardirqs last disabled at (1391356): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.013555] softirqs last enabled at (1388690): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.013557] softirqs last disabled at (1388683): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.013561] ---[ end trace 0000000000000000 ]--- <6> [235.013563] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.013665] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.013675] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.013897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.014103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.014193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.014287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.014377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.014464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.014551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.014650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.014750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.014836] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.014933] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.015051] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.016063] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.026648] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.026899] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.027949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.028028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.028106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.028184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.028262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.028339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.028416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.028492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.028572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.028659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.028747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.028822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.028897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.028971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.029045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.029120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.029193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.029267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.029340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.029424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.029509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.029590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.029687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.029774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.029852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.029929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.030006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.030087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.030170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.030251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.030333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.030414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.030498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.030584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.030684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.030776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.030858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.030937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.031017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.031094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.031174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.031253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.031331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.031407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.031487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.031564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.031649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.031741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.031824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.031903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.031981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.032061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.032138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.032216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.032292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.032368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.032443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.032519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.032602] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.032735] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.032739] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46425, lrc_seqno=46425, guc_id=0, flags=0x73 in no process [-1] <7> [235.032741] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.032801] ------------[ cut here ]------------ <4> [235.032803] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.032804] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.032875] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.032940] autofs4 [last unloaded: snd_hda_intel] <4> [235.032944] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.032947] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.032948] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.032949] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.032955] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.033024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.033025] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.033028] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.033029] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.033030] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.033031] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.033033] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.033034] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.033036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.033037] CR2: 0000749c879c7000 CR3: 0000000122e3e003 CR4: 0000000000f72ef0 <4> [235.033038] PKRU: 55555554 <4> [235.033040] Call Trace: <4> [235.033041] <TASK> <4> [235.033044] ? lock_sync+0x100/0x100 <4> [235.033049] ? lock_release+0xd0/0x2b0 <4> [235.033054] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.033060] process_one_work+0x239/0x760 <4> [235.033066] worker_thread+0x200/0x3f0 <4> [235.033069] ? __pfx_worker_thread+0x10/0x10 <4> [235.033071] kthread+0x10d/0x150 <4> [235.033074] ? __pfx_kthread+0x10/0x10 <4> [235.033078] ret_from_fork+0x3d4/0x480 <4> [235.033080] ? __pfx_kthread+0x10/0x10 <4> [235.033083] ret_from_fork_asm+0x1a/0x30 <4> [235.033090] </TASK> <4> [235.033092] irq event stamp: 1394433 <4> [235.033093] hardirqs last enabled at (1394439): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.033095] hardirqs last disabled at (1394444): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.033098] softirqs last enabled at (1393420): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.033100] softirqs last disabled at (1393413): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.033102] ---[ end trace 0000000000000000 ]--- <6> [235.033104] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.033173] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.033179] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.034424] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.034530] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.034636] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.034860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.034954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.035052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.035141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.035230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.035316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.035401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.035488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.035570] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.035668] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.035785] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.036792] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.046647] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.046896] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.047923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.048005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.048081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.048159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.048236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.048312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.048387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.048462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.048538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.048613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.048698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.048774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.048849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.048928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.049006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.049083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.049158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.049233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.049308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.049390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.049472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.049551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.049634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.049730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.049810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.049888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.049965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.050045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.050125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.050204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.050287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.050369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.050455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.050541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.050625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.050719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.050800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.050877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.050955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.051032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.051111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.051189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.051265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.051342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.051422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.051500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.051580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.051665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.051746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.051824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.051901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.051981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.052057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.052135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.052210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.052287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.052363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.052438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.052517] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.052629] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.052633] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46425, lrc_seqno=46425, guc_id=0, flags=0x73 in no process [-1] <7> [235.052635] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.052725] ------------[ cut here ]------------ <4> [235.052726] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.052727] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [235.052800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.052865] autofs4 [last unloaded: snd_hda_intel] <4> [235.052869] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.052872] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.052873] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.052875] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.052880] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.052951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.052953] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.052955] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.052956] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.052958] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.052959] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.052960] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.052962] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.052963] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.052964] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.052966] PKRU: 55555554 <4> [235.052967] Call Trace: <4> [235.052968] <TASK> <4> [235.052972] ? lock_sync+0x100/0x100 <4> [235.052977] ? lock_release+0xd0/0x2b0 <4> [235.052982] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.052988] process_one_work+0x239/0x760 <4> [235.052994] worker_thread+0x200/0x3f0 <4> [235.052997] ? __pfx_worker_thread+0x10/0x10 <4> [235.052999] kthread+0x10d/0x150 <4> [235.053002] ? __pfx_kthread+0x10/0x10 <4> [235.053006] ret_from_fork+0x3d4/0x480 <4> [235.053008] ? __pfx_kthread+0x10/0x10 <4> [235.053011] ret_from_fork_asm+0x1a/0x30 <4> [235.053018] </TASK> <4> [235.053020] irq event stamp: 618195 <4> [235.053021] hardirqs last enabled at (618201): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.053024] hardirqs last disabled at (618206): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.053026] softirqs last enabled at (617434): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.053029] softirqs last disabled at (617377): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.053031] ---[ end trace 0000000000000000 ]--- <5> [235.054252] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46480, lrc_seqno=46480, guc_id=0, flags=0x73 in no process [-1] <7> [235.054255] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.054318] ------------[ cut here ]------------ <4> [235.054319] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.054320] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [235.054390] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.054454] autofs4 [last unloaded: snd_hda_intel] <4> [235.054458] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.054460] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.054461] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.054463] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.054468] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.054537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.054539] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.054541] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.054542] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.054543] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.054544] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.054545] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.054547] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.054548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.054550] CR2: 0000733a3e633000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.054551] PKRU: 55555554 <4> [235.054552] Call Trace: <4> [235.054553] <TASK> <4> [235.054557] ? lock_sync+0x100/0x100 <4> [235.054561] ? lock_release+0xd0/0x2b0 <4> [235.054568] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.054574] process_one_work+0x239/0x760 <4> [235.054580] worker_thread+0x200/0x3f0 <4> [235.054583] ? __pfx_worker_thread+0x10/0x10 <4> [235.054585] kthread+0x10d/0x150 <4> [235.054588] ? __pfx_kthread+0x10/0x10 <4> [235.054592] ret_from_fork+0x3d4/0x480 <4> [235.054594] ? __pfx_kthread+0x10/0x10 <4> [235.054597] ret_from_fork_asm+0x1a/0x30 <4> [235.054604] </TASK> <4> [235.054606] irq event stamp: 620071 <4> [235.054607] hardirqs last enabled at (620077): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.054609] hardirqs last disabled at (620082): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.054611] softirqs last enabled at (617434): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.054614] softirqs last disabled at (617377): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.054616] ---[ end trace 0000000000000000 ]--- <6> [235.054618] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.054697] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.054704] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.054863] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.054966] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.055122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.055354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.055455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.055555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.055655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.055748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.055839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.055930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.056024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.056112] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.056213] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.056338] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.057352] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.067645] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.067900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.068906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.068993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.069078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.069161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.069243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.069321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.069400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.069479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.069557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.069643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.069723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.069801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.069880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.069958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.070037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.070116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.070195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.070273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.070352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.070441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.070531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.070617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.070715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.070803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.070888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.070972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.071055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.071141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.071227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.071310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.071394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.071477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.071566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.071659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.071754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.071844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.071931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.072014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.072097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.072178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.072262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.072346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.072428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.072509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.072594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.072684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.072767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.072849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.072936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.073021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.073104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.073191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.073273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.073356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.073437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.073520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.073601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.073697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.073786] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.073903] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.073908] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46480, lrc_seqno=46480, guc_id=0, flags=0x73 in no process [-1] <7> [235.073910] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.073972] ------------[ cut here ]------------ <4> [235.073974] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.073975] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:10/2392 <4> [235.074052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.074117] autofs4 [last unloaded: snd_hda_intel] <4> [235.074121] CPU: 7 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.074124] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.074125] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.074127] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.074132] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.074206] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.074208] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.074210] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.074212] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.074213] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.074214] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.074216] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.074217] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.074219] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.074220] CR2: 000000c000442000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [235.074222] PKRU: 55555554 <4> [235.074223] Call Trace: <4> [235.074224] <TASK> <4> [235.074228] ? lock_sync+0x100/0x100 <4> [235.074233] ? lock_release+0xd0/0x2b0 <4> [235.074238] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.074244] process_one_work+0x239/0x760 <4> [235.074251] worker_thread+0x200/0x3f0 <4> [235.074253] ? __pfx_worker_thread+0x10/0x10 <4> [235.074256] kthread+0x10d/0x150 <4> [235.074259] ? __pfx_kthread+0x10/0x10 <4> [235.074262] ret_from_fork+0x3d4/0x480 <4> [235.074264] ? __pfx_kthread+0x10/0x10 <4> [235.074268] ret_from_fork_asm+0x1a/0x30 <4> [235.074275] </TASK> <4> [235.074276] irq event stamp: 164591 <4> [235.074277] hardirqs last enabled at (164597): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.074280] hardirqs last disabled at (164602): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.074283] softirqs last enabled at (163742): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.074285] softirqs last disabled at (163725): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.074287] ---[ end trace 0000000000000000 ]--- <6> [235.074289] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.074367] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.074373] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.075616] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.075741] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.075855] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.076076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.076167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.076263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.076354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.076445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.076533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.076621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.076739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.076823] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.076921] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.077042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.078055] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.088778] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.089031] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.090288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.090374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.090454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.090533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.090613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.090706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.090791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.090867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.090943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.091018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.091092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.091167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.091241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.091314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.091388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.091463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.091540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.091617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.091711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.091805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.091886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.091965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.092045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.092123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.092202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.092280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.092361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.092443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.092524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.092604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.092698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.092787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.092873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.092957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.093042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.093123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.093203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.093281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.093362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.093442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.093523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.093601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.093693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.093782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.093863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.093942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.094020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.094096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.094175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.094253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.094330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.094414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.094496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.094576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.094661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.094752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.094829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.094907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.094991] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.095105] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.095110] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46480, lrc_seqno=46480, guc_id=0, flags=0x73 in no process [-1] <7> [235.095112] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.095171] ------------[ cut here ]------------ <4> [235.095172] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.095174] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.095247] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.095314] autofs4 [last unloaded: snd_hda_intel] <4> [235.095318] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.095321] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.095322] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.095323] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.095329] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.095398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.095400] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.095402] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.095403] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.095405] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.095406] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.095407] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.095408] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.095410] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.095411] CR2: 0000749c879c7000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.095413] PKRU: 55555554 <4> [235.095414] Call Trace: <4> [235.095415] <TASK> <4> [235.095419] ? lock_sync+0x100/0x100 <4> [235.095424] ? lock_release+0xd0/0x2b0 <4> [235.095429] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.095435] process_one_work+0x239/0x760 <4> [235.095442] worker_thread+0x200/0x3f0 <4> [235.095444] ? __pfx_worker_thread+0x10/0x10 <4> [235.095447] kthread+0x10d/0x150 <4> [235.095450] ? __pfx_kthread+0x10/0x10 <4> [235.095454] ret_from_fork+0x3d4/0x480 <4> [235.095456] ? __pfx_kthread+0x10/0x10 <4> [235.095459] ret_from_fork_asm+0x1a/0x30 <4> [235.095466] </TASK> <4> [235.095468] irq event stamp: 1397835 <4> [235.095469] hardirqs last enabled at (1397841): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.095472] hardirqs last disabled at (1397846): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.095474] softirqs last enabled at (1396786): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.095476] softirqs last disabled at (1396779): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.095478] ---[ end trace 0000000000000000 ]--- <5> [235.096662] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46535, lrc_seqno=46535, guc_id=0, flags=0x73 in no process [-1] <7> [235.096671] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.096792] ------------[ cut here ]------------ <4> [235.096794] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.096795] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:3/191 <7> [235.096797] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [235.096872] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.096944] autofs4 [last unloaded: snd_hda_intel] <4> [235.096948] CPU: 2 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.096951] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.096952] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <7> [235.096903] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [235.096954] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.096959] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.097031] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.097033] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.097035] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.097036] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.097038] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.097039] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.097040] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.097041] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.097043] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.097044] CR2: 0000733a3e633000 CR3: 000000011f50b004 CR4: 0000000000f72ef0 <4> [235.097046] PKRU: 55555554 <4> [235.097047] Call Trace: <4> [235.097048] <TASK> <4> [235.097052] ? lock_sync+0x100/0x100 <4> [235.097056] ? lock_release+0xd0/0x2b0 <4> [235.097062] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.097068] process_one_work+0x239/0x760 <4> [235.097074] worker_thread+0x200/0x3f0 <4> [235.097076] ? __pfx_worker_thread+0x10/0x10 <4> [235.097079] kthread+0x10d/0x150 <4> [235.097082] ? __pfx_kthread+0x10/0x10 <4> [235.097085] ret_from_fork+0x3d4/0x480 <4> [235.097087] ? __pfx_kthread+0x10/0x10 <4> [235.097091] ret_from_fork_asm+0x1a/0x30 <4> [235.097098] </TASK> <4> [235.097099] irq event stamp: 1399721 <4> [235.097100] hardirqs last enabled at (1399727): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.097103] hardirqs last disabled at (1399732): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.097105] softirqs last enabled at (1396786): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.097108] softirqs last disabled at (1396779): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.097110] ---[ end trace 0000000000000000 ]--- <6> [235.097112] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.097183] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.097189] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.097373] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.097576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.097675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.097770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.097862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.097950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.098037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.098124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.098212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.098296] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.098392] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.098512] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.099520] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.109686] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.109939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.110916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.110995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.111073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.111151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.111227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.111302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.111378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.111453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.111528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.111602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.111687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.111762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.111837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.111914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.111990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.112066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.112140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.112215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.112290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.112373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.112455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.112535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.112615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.112702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.112780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.112858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.112939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.113021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.113102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.113180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.113260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.113338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.113422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.113506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.113590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.113677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.113757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.113835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.113911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.113987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.114071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.114151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.114231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.114308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.114389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.114467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.114545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.114621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.114720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.114797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.114876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.114960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.115040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.115119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.115196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.115275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.115352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.115428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.115507] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.115619] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.115624] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46535, lrc_seqno=46535, guc_id=0, flags=0x73 in no process [-1] <7> [235.115626] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.116550] ------------[ cut here ]------------ <4> [235.116552] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.116553] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:3/191 <4> [235.116627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.116697] autofs4 [last unloaded: snd_hda_intel] <4> [235.116701] CPU: 2 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.116704] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.116705] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.116706] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.116712] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.116782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.116784] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.116786] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.116787] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.116788] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.116790] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.116791] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.116792] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.116794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.116795] CR2: 0000733a3e633000 CR3: 000000011f50b004 CR4: 0000000000f72ef0 <4> [235.116797] PKRU: 55555554 <4> [235.116798] Call Trace: <4> [235.116799] <TASK> <4> [235.116803] ? lock_sync+0x100/0x100 <4> [235.116807] ? lock_release+0xd0/0x2b0 <4> [235.116813] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.116819] process_one_work+0x239/0x760 <4> [235.116825] worker_thread+0x200/0x3f0 <4> [235.116828] ? __pfx_worker_thread+0x10/0x10 <4> [235.116830] kthread+0x10d/0x150 <4> [235.116833] ? __pfx_kthread+0x10/0x10 <4> [235.116836] ret_from_fork+0x3d4/0x480 <4> [235.116838] ? __pfx_kthread+0x10/0x10 <4> [235.116842] ret_from_fork_asm+0x1a/0x30 <4> [235.116849] </TASK> <4> [235.116850] irq event stamp: 1402885 <4> [235.116851] hardirqs last enabled at (1402891): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.116854] hardirqs last disabled at (1402896): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.116856] softirqs last enabled at (1402118): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.116859] softirqs last disabled at (1402111): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.116861] ---[ end trace 0000000000000000 ]--- <6> [235.116863] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.116935] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.116941] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.116956] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.117061] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.117349] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.117556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.117654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.117772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.117862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.117950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.118041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.118130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.118220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.118304] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.118401] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.118518] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.119529] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.129649] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.129901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.130935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.131014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.131090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.131167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.131244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.131322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.131399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.131474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.131550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.131625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.131716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.131802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.131879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.131955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.132029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.132103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.132178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.132253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.132328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.132410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.132491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.132570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.132659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.132748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.132830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.132912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.132991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.133072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.133154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.133234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.133313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.133393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.133478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.133562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.133651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.133745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.133829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.133910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.133990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.134068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.134149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.134227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.134305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.134382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.134462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.134539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.134617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.134707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.134797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.134872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.134948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.135027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.135105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.135182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.135258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.135336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.135412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.135487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.135565] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.135685] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.135690] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46535, lrc_seqno=46535, guc_id=0, flags=0x73 in no process [-1] <7> [235.135692] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.135752] ------------[ cut here ]------------ <4> [235.135753] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.135755] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:1/120 <4> [235.135826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.135891] autofs4 [last unloaded: snd_hda_intel] <4> [235.135895] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.135898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.135899] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.135901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.135906] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.135975] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.135977] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.135979] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.135981] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.135982] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.135983] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.135984] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.135986] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.135988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.135989] CR2: 0000749c879c7000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.135990] PKRU: 55555554 <4> [235.135992] Call Trace: <4> [235.135993] <TASK> <4> [235.135997] ? lock_sync+0x100/0x100 <4> [235.136001] ? lock_release+0xd0/0x2b0 <4> [235.136006] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.136012] process_one_work+0x239/0x760 <4> [235.136018] worker_thread+0x200/0x3f0 <4> [235.136021] ? __pfx_worker_thread+0x10/0x10 <4> [235.136023] kthread+0x10d/0x150 <4> [235.136026] ? __pfx_kthread+0x10/0x10 <4> [235.136030] ret_from_fork+0x3d4/0x480 <4> [235.136032] ? __pfx_kthread+0x10/0x10 <4> [235.136035] ret_from_fork_asm+0x1a/0x30 <4> [235.136042] </TASK> <4> [235.136043] irq event stamp: 625283 <4> [235.136044] hardirqs last enabled at (625289): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.136047] hardirqs last disabled at (625294): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.136049] softirqs last enabled at (624368): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.136052] softirqs last disabled at (624363): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.136054] ---[ end trace 0000000000000000 ]--- <5> [235.137281] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46590, lrc_seqno=46590, guc_id=0, flags=0x73 in no process [-1] <7> [235.137284] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.137346] ------------[ cut here ]------------ <4> [235.137347] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.137349] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:1/120 <4> [235.137419] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.137482] autofs4 [last unloaded: snd_hda_intel] <4> [235.137485] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.137488] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.137489] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.137490] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.137495] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.137563] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.137564] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.137566] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.137568] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.137569] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.137570] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.137571] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.137573] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.137574] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.137576] CR2: 0000749c879c7000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.137577] PKRU: 55555554 <4> [235.137578] Call Trace: <4> [235.137579] <TASK> <4> [235.137583] ? lock_sync+0x100/0x100 <4> [235.137587] ? lock_release+0xd0/0x2b0 <4> [235.137593] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.137598] process_one_work+0x239/0x760 <4> [235.137604] worker_thread+0x200/0x3f0 <4> [235.137607] ? __pfx_worker_thread+0x10/0x10 <4> [235.137609] kthread+0x10d/0x150 <4> [235.137612] ? __pfx_kthread+0x10/0x10 <4> [235.137616] ret_from_fork+0x3d4/0x480 <4> [235.137618] ? __pfx_kthread+0x10/0x10 <4> [235.137621] ret_from_fork_asm+0x1a/0x30 <4> [235.137628] </TASK> <4> [235.137629] irq event stamp: 627183 <4> [235.137630] hardirqs last enabled at (627189): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.137633] hardirqs last disabled at (627194): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.137635] softirqs last enabled at (624368): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.137649] softirqs last disabled at (627207): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.137653] ---[ end trace 0000000000000000 ]--- <7> [235.137678] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [235.137727] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.137842] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.137851] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.137831] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.137978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.138180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.138272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.138367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.138456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.138543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.138629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.138750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.138842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.138925] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.139021] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.139140] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.140151] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.150648] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.150901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.151949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.152036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.152113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.152189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.152266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.152343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.152419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.152496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.152575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.152659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.152745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.152821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.152897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.152973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.153048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.153123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.153197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.153272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.153346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.153427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.153511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.153591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.153686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.153773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.153850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.153928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.154005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.154086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.154165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.154244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.154322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.154403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.154492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.154577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.154671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.154761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.154847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.154928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.155007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.155085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.155168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.155249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.155327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.155404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.155485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.155563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.155649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.155737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.155815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.155891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.155966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.156048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.156129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.156210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.156288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.156368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.156444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.156520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.156599] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.156730] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.156735] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46590, lrc_seqno=46590, guc_id=0, flags=0x73 in no process [-1] <7> [235.156737] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.156796] ------------[ cut here ]------------ <4> [235.156797] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.156798] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:1/120 <4> [235.156870] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.156935] autofs4 [last unloaded: snd_hda_intel] <4> [235.156939] CPU: 5 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.156942] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.156943] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.156944] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.156949] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.157018] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.157020] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.157022] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.157024] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.157025] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.157026] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.157028] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.157029] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [235.157031] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.157032] CR2: 0000749c879c9000 CR3: 0000000122e3e001 CR4: 0000000000f72ef0 <4> [235.157033] PKRU: 55555554 <4> [235.157035] Call Trace: <4> [235.157036] <TASK> <4> [235.157040] ? lock_sync+0x100/0x100 <4> [235.157044] ? lock_release+0xd0/0x2b0 <4> [235.157049] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.157055] process_one_work+0x239/0x760 <4> [235.157061] worker_thread+0x200/0x3f0 <4> [235.157064] ? __pfx_worker_thread+0x10/0x10 <4> [235.157066] kthread+0x10d/0x150 <4> [235.157069] ? __pfx_kthread+0x10/0x10 <4> [235.157073] ret_from_fork+0x3d4/0x480 <4> [235.157075] ? __pfx_kthread+0x10/0x10 <4> [235.157078] ret_from_fork_asm+0x1a/0x30 <4> [235.157086] </TASK> <4> [235.157087] irq event stamp: 630329 <4> [235.157088] hardirqs last enabled at (630335): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.157091] hardirqs last disabled at (630340): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.157093] softirqs last enabled at (629408): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.157096] softirqs last disabled at (629401): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.157098] ---[ end trace 0000000000000000 ]--- <6> [235.157100] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.157171] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.157177] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.157580] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.157800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.157891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.157983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.158072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.158159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.158244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.158330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.158421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.158506] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.158601] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.158735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.159753] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.170478] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.170735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.171748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.171829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.171906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.171985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.172063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.172141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.172216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.172291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.172366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.172440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.172514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.172587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.172670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.172759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.172836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.172912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.172986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.173060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.173134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.173215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.173297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.173376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.173460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.173539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.173618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.173711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.173800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.173884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.173967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.174048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.174128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.174207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.174292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.174377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.174464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.174549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.174631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.174727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.174816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.174895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.174976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.175058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.175141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.175220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.175303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.175382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.175461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.175538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.175617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.175706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.175794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.175875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.175954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.176033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.176117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.176199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.176278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.176356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.176437] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.176549] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.176553] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46590, lrc_seqno=46590, guc_id=0, flags=0x73 in no process [-1] <7> [235.176556] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.176615] ------------[ cut here ]------------ <4> [235.176616] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.176617] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:1/120 <4> [235.176701] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.176787] autofs4 [last unloaded: snd_hda_intel] <4> [235.176791] CPU: 5 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.176793] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.176795] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.176796] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.176801] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.176872] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.176873] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.176875] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.176877] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.176878] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.176879] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.176880] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.176882] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [235.176883] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.176885] CR2: 0000749c879c9000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.176886] PKRU: 55555554 <4> [235.176887] Call Trace: <4> [235.176888] <TASK> <4> [235.176892] ? lock_sync+0x100/0x100 <4> [235.176896] ? lock_release+0xd0/0x2b0 <4> [235.176902] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.176908] process_one_work+0x239/0x760 <4> [235.176914] worker_thread+0x200/0x3f0 <4> [235.176917] ? __pfx_worker_thread+0x10/0x10 <4> [235.176919] kthread+0x10d/0x150 <4> [235.176922] ? __pfx_kthread+0x10/0x10 <4> [235.176926] ret_from_fork+0x3d4/0x480 <4> [235.176928] ? __pfx_kthread+0x10/0x10 <4> [235.176931] ret_from_fork_asm+0x1a/0x30 <4> [235.176939] </TASK> <4> [235.176940] irq event stamp: 633453 <4> [235.176941] hardirqs last enabled at (633459): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.176944] hardirqs last disabled at (633464): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.176946] softirqs last enabled at (632550): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.176948] softirqs last disabled at (632545): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.176951] ---[ end trace 0000000000000000 ]--- <5> [235.178151] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46645, lrc_seqno=46645, guc_id=0, flags=0x73 in no process [-1] <7> [235.178156] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.178228] ------------[ cut here ]------------ <4> [235.178229] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [235.178206] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [235.178231] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/120 <4> [235.178307] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 <7> [235.178310] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [235.178358] mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [235.178376] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.178379] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.178380] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.178381] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.178386] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.178457] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.178459] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.178461] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.178462] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.178464] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.178465] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.178466] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.178468] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.178469] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.178471] CR2: 00007dd8c736e008 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.178472] PKRU: 55555554 <4> [235.178473] Call Trace: <4> [235.178474] <TASK> <4> [235.178478] ? lock_sync+0x100/0x100 <4> [235.178483] ? lock_release+0xd0/0x2b0 <4> [235.178489] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.178494] process_one_work+0x239/0x760 <4> [235.178500] worker_thread+0x200/0x3f0 <4> [235.178503] ? __pfx_worker_thread+0x10/0x10 <4> [235.178506] kthread+0x10d/0x150 <4> [235.178509] ? __pfx_kthread+0x10/0x10 <4> [235.178512] ret_from_fork+0x3d4/0x480 <4> [235.178514] ? __pfx_kthread+0x10/0x10 <4> [235.178518] ret_from_fork_asm+0x1a/0x30 <4> [235.178525] </TASK> <4> [235.178526] irq event stamp: 635455 <4> [235.178527] hardirqs last enabled at (635461): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.178530] hardirqs last disabled at (635466): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.178532] softirqs last enabled at (632550): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.178535] softirqs last disabled at (632545): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.178537] ---[ end trace 0000000000000000 ]--- <6> [235.178539] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.178610] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.178618] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.178758] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.179167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.179261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.179358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.179447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.179534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.179620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.179721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.179808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.179891] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.179986] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.180108] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.181123] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.191650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.191900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.192912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.192991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.193079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.193175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.193270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.193351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.193427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.193501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.193575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.193657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.193733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.193809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.193883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.193958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.194033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.194108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.194182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.194256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.194330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.194414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.194495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.194573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.194658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.194737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.194814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.194890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.194966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.195045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.195124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.195203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.195283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.195367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.195456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.195544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.195630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.195728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.195810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.195891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.195972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.196049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.196130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.196209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.196286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.196363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.196444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.196521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.196599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.196689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.196772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.196851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.196929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.197009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.197087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.197163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.197240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.197318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.197396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.197478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.197562] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.197715] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.198570] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46645, lrc_seqno=46645, guc_id=0, flags=0x73 in no process [-1] <7> [235.198573] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.198643] ------------[ cut here ]------------ <4> [235.198644] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.198646] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.198723] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.198789] autofs4 [last unloaded: snd_hda_intel] <4> [235.198793] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.198796] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.198797] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.198799] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.198807] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.198878] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.198880] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.198882] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.198884] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.198885] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.198886] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.198887] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.198889] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.198890] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.198892] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.198893] PKRU: 55555554 <4> [235.198894] Call Trace: <4> [235.198895] <TASK> <4> [235.198899] ? lock_sync+0x100/0x100 <4> [235.198904] ? lock_release+0xd0/0x2b0 <4> [235.198909] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.198915] process_one_work+0x239/0x760 <4> [235.198921] worker_thread+0x200/0x3f0 <4> [235.198924] ? __pfx_worker_thread+0x10/0x10 <4> [235.198926] kthread+0x10d/0x150 <4> [235.198929] ? __pfx_kthread+0x10/0x10 <4> [235.198933] ret_from_fork+0x3d4/0x480 <4> [235.198935] ? __pfx_kthread+0x10/0x10 <4> [235.198939] ret_from_fork_asm+0x1a/0x30 <4> [235.198946] </TASK> <4> [235.198947] irq event stamp: 638591 <4> [235.198948] hardirqs last enabled at (638597): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.198951] hardirqs last disabled at (638602): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.198953] softirqs last enabled at (637660): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.198956] softirqs last disabled at (637653): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.198958] ---[ end trace 0000000000000000 ]--- <6> [235.198960] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.199031] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.199037] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.199451] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.199557] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.199672] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.199876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.199965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.200060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.200150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.200238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.200325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.200411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.200496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.200579] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.200682] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.200799] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.201812] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.211650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.211900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.212925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.213004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.213080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.213157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.213236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.213315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.213391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.213467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.213542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.213617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.213705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.213779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.213852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.213926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.213998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.214072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.214145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.214217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.214291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.214374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.214459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.214538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.214618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.214709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.214787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.214866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.214945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.215025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.215105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.215182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.215262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.215339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.215422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.215506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.215590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.215677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.215757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.215840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.215920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.215998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.216080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.216159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.216236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.216312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.216392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.216469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.216546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.216622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.216709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.216785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.216861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.216945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.217026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.217105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.217182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.217260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.217335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.217411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.217491] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.217602] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.217606] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46645, lrc_seqno=46645, guc_id=0, flags=0x73 in no process [-1] <7> [235.217608] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.217682] ------------[ cut here ]------------ <4> [235.217683] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.217685] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.217755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.217820] autofs4 [last unloaded: snd_hda_intel] <4> [235.217824] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.217827] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.217828] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.217829] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.217835] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.217905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.217907] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.217909] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.217911] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.217912] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.217913] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.217914] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.217915] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.217917] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.217918] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.217920] PKRU: 55555554 <4> [235.217921] Call Trace: <4> [235.217922] <TASK> <4> [235.217926] ? lock_sync+0x100/0x100 <4> [235.217930] ? lock_release+0xd0/0x2b0 <4> [235.217936] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.217942] process_one_work+0x239/0x760 <4> [235.217948] worker_thread+0x200/0x3f0 <4> [235.217951] ? __pfx_worker_thread+0x10/0x10 <4> [235.217953] kthread+0x10d/0x150 <4> [235.217956] ? __pfx_kthread+0x10/0x10 <4> [235.217960] ret_from_fork+0x3d4/0x480 <4> [235.217962] ? __pfx_kthread+0x10/0x10 <4> [235.217965] ret_from_fork_asm+0x1a/0x30 <4> [235.217972] </TASK> <4> [235.217974] irq event stamp: 641789 <4> [235.217975] hardirqs last enabled at (641795): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.217978] hardirqs last disabled at (641800): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.217980] softirqs last enabled at (641028): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.217982] softirqs last disabled at (641013): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.217985] ---[ end trace 0000000000000000 ]--- <5> [235.219205] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46700, lrc_seqno=46700, guc_id=0, flags=0x73 in no process [-1] <7> [235.219208] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.219272] ------------[ cut here ]------------ <4> [235.219273] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.219274] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.219347] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.219410] autofs4 [last unloaded: snd_hda_intel] <4> [235.219414] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.219416] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.219417] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.219419] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.219424] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.219493] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.219494] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.219497] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.219498] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.219499] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.219500] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.219501] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.219503] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.219504] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.219505] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.219507] PKRU: 55555554 <4> [235.219508] Call Trace: <4> [235.219509] <TASK> <4> [235.219513] ? lock_sync+0x100/0x100 <4> [235.219517] ? lock_release+0xd0/0x2b0 <4> [235.219522] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.219528] process_one_work+0x239/0x760 <4> [235.219533] worker_thread+0x200/0x3f0 <4> [235.219536] ? __pfx_worker_thread+0x10/0x10 <4> [235.219538] kthread+0x10d/0x150 <4> [235.219541] ? __pfx_kthread+0x10/0x10 <4> [235.219545] ret_from_fork+0x3d4/0x480 <4> [235.219547] ? __pfx_kthread+0x10/0x10 <4> [235.219550] ret_from_fork_asm+0x1a/0x30 <4> [235.219558] </TASK> <4> [235.219559] irq event stamp: 643653 <4> [235.219560] hardirqs last enabled at (643659): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.219562] hardirqs last disabled at (643664): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.219565] softirqs last enabled at (641028): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.219567] softirqs last disabled at (641013): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.219569] ---[ end trace 0000000000000000 ]--- <6> [235.219571] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.219644] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.219650] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.219875] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.219978] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.220085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.220287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.220375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.220467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.220558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.220653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.220741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.220828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.220914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.220995] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.221091] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.221207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.222216] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.232649] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.232921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.233890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.233969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.234046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.234124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.234201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.234277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.234352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.234427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.234502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.234577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.234656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.234752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.234829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.234905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.234980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.235056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.235130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.235204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.235278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.235359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.235442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.235524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.235606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.235694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.235772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.235850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.235928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.236008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.236093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.236175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.236256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.236336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.236421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.236508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.236596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.236693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.236774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.236855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.236934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.237011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.237090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.237167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.237248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.237327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.237409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.237488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.237565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.237645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.237724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.237801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.237877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.237956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.238036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.238116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.238195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.238275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.238352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.238427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.238510] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.238621] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.238625] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46700, lrc_seqno=46700, guc_id=0, flags=0x73 in no process [-1] <7> [235.238627] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.239549] ------------[ cut here ]------------ <4> [235.239550] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.239552] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.239627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.239721] autofs4 [last unloaded: snd_hda_intel] <4> [235.239725] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.239728] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.239729] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.239730] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.239736] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.239805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.239806] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.239808] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.239810] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.239811] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.239812] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.239813] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.239815] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.239816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.239818] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.239819] PKRU: 55555554 <4> [235.239820] Call Trace: <4> [235.239821] <TASK> <4> [235.239825] ? lock_sync+0x100/0x100 <4> [235.239830] ? lock_release+0xd0/0x2b0 <4> [235.239835] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.239841] process_one_work+0x239/0x760 <4> [235.239848] worker_thread+0x200/0x3f0 <4> [235.239851] ? __pfx_worker_thread+0x10/0x10 <4> [235.239854] kthread+0x10d/0x150 <4> [235.239856] ? __pfx_kthread+0x10/0x10 <4> [235.239860] ret_from_fork+0x3d4/0x480 <4> [235.239862] ? __pfx_kthread+0x10/0x10 <4> [235.239866] ret_from_fork_asm+0x1a/0x30 <4> [235.239873] </TASK> <4> [235.239874] irq event stamp: 646753 <4> [235.239875] hardirqs last enabled at (646759): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.239878] hardirqs last disabled at (646764): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.239880] softirqs last enabled at (645744): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.239883] softirqs last disabled at (645737): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.239885] ---[ end trace 0000000000000000 ]--- <6> [235.239886] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.239956] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.239962] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.239977] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.240079] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.240374] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.240583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.240701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.240799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.240891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.240980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.241068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.241155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.241247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.241333] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.241431] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.241552] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.242556] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.252649] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.252901] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.254194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.254278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.254357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.254435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.254511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.254588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.254673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.254748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.254824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.254903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.254982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.255058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.255133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.255208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.255282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.255356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.255430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.255503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.255577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.255668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.255749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.255828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.255910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.255990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.256067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.256148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.256228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.256310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.256391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.256471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.256551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.256631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.256731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.256816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.256902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.256984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.257065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.257142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.257220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.257297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.257379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.257462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.257544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.257623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.257717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.257795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.257872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.257949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.258028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.258104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.258181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.258266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.258348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.258428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.258506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.258586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.258671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.258752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.258836] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.258953] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.258957] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46700, lrc_seqno=46700, guc_id=0, flags=0x73 in no process [-1] <7> [235.258959] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.259019] ------------[ cut here ]------------ <4> [235.259020] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.259021] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:3/191 <4> [235.259094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.259159] autofs4 [last unloaded: snd_hda_intel] <4> [235.259163] CPU: 6 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.259166] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.259167] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.259169] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.259174] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.259244] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.259246] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.259248] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.259250] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.259251] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.259252] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.259253] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.259255] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.259256] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.259257] CR2: 00007dd8c736e008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.259259] PKRU: 55555554 <4> [235.259260] Call Trace: <4> [235.259261] <TASK> <4> [235.259265] ? lock_sync+0x100/0x100 <4> [235.259270] ? lock_release+0xd0/0x2b0 <4> [235.259275] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.259281] process_one_work+0x239/0x760 <4> [235.259287] worker_thread+0x200/0x3f0 <4> [235.259290] ? __pfx_worker_thread+0x10/0x10 <4> [235.259292] kthread+0x10d/0x150 <4> [235.259295] ? __pfx_kthread+0x10/0x10 <4> [235.259299] ret_from_fork+0x3d4/0x480 <4> [235.259301] ? __pfx_kthread+0x10/0x10 <4> [235.259304] ret_from_fork_asm+0x1a/0x30 <4> [235.259311] </TASK> <4> [235.259312] irq event stamp: 1407511 <4> [235.259314] hardirqs last enabled at (1407517): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.259317] hardirqs last disabled at (1407522): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.259319] softirqs last enabled at (1406574): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.259321] softirqs last disabled at (1406569): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.259323] ---[ end trace 0000000000000000 ]--- <5> [235.260524] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46755, lrc_seqno=46755, guc_id=0, flags=0x73 in no process [-1] <7> [235.260528] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.260588] ------------[ cut here ]------------ <4> [235.260589] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.260590] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:3/191 <4> [235.260681] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.260795] autofs4 [last unloaded: snd_hda_intel] <4> [235.260799] CPU: 6 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.260802] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.260804] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.260805] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.260811] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.260888] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.260889] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.260891] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.260893] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.260894] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.260895] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.260896] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.260898] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.260899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.260900] CR2: 00007dd8c736e008 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.260902] PKRU: 55555554 <4> [235.260903] Call Trace: <4> [235.260904] <TASK> <4> [235.260908] ? lock_sync+0x100/0x100 <4> [235.260912] ? lock_release+0xd0/0x2b0 <4> [235.260917] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.260923] process_one_work+0x239/0x760 <4> [235.260929] worker_thread+0x200/0x3f0 <4> [235.260932] ? __pfx_worker_thread+0x10/0x10 <4> [235.260934] kthread+0x10d/0x150 <4> [235.260937] ? __pfx_kthread+0x10/0x10 <4> [235.260940] ret_from_fork+0x3d4/0x480 <4> [235.260942] ? __pfx_kthread+0x10/0x10 <4> [235.260946] ret_from_fork_asm+0x1a/0x30 <4> [235.260953] </TASK> <4> [235.260954] irq event stamp: 1409505 <4> [235.260955] hardirqs last enabled at (1409511): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.260958] hardirqs last disabled at (1409516): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.260960] softirqs last enabled at (1408762): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.260962] softirqs last disabled at (1408757): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.260965] ---[ end trace 0000000000000000 ]--- <7> [235.260980] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.261085] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [235.261184] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.261256] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.261263] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.261464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.261687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.261782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.261878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.261972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.262063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.262151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.262238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.262326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.262409] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.262505] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.262623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.263648] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.273648] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.273900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.274927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.275006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.275084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.275162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.275240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.275317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.275396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.275473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.275548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.275623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.275717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.275792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.275866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.275942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.276019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.276095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.276171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.276246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.276321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.276402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.276484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.276563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.276650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.276728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.276806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.276883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.276959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.277039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.277118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.277201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.277283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.277363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.277447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.277533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.277617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.277711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.277791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.277871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.277952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.278030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.278111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.278189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.278268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.278347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.278428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.278505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.278582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.278661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.278739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.278815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.278891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.278970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.279048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.279125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.279205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.279289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.279369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.279447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.279527] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.279639] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.279647] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46755, lrc_seqno=46755, guc_id=0, flags=0x73 in no process [-1] <7> [235.279650] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.279709] ------------[ cut here ]------------ <4> [235.279710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.279711] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.279783] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.279847] autofs4 [last unloaded: snd_hda_intel] <4> [235.279851] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.279854] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.279855] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.279857] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.279862] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.279932] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.279934] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.279936] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.279937] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.279939] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.279940] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.279941] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.279942] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.279944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.279945] CR2: 0000749c879ca000 CR3: 0000000122e3e003 CR4: 0000000000f72ef0 <4> [235.279947] PKRU: 55555554 <4> [235.279948] Call Trace: <4> [235.279949] <TASK> <4> [235.279953] ? lock_sync+0x100/0x100 <4> [235.279958] ? lock_release+0xd0/0x2b0 <4> [235.279963] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.279969] process_one_work+0x239/0x760 <4> [235.279975] worker_thread+0x200/0x3f0 <4> [235.279978] ? __pfx_worker_thread+0x10/0x10 <4> [235.279980] kthread+0x10d/0x150 <4> [235.279983] ? __pfx_kthread+0x10/0x10 <4> [235.279987] ret_from_fork+0x3d4/0x480 <4> [235.279989] ? __pfx_kthread+0x10/0x10 <4> [235.279992] ret_from_fork_asm+0x1a/0x30 <4> [235.279999] </TASK> <4> [235.280000] irq event stamp: 1412671 <4> [235.280001] hardirqs last enabled at (1412677): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.280004] hardirqs last disabled at (1412682): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.280007] softirqs last enabled at (1411756): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.280009] softirqs last disabled at (1411749): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.280011] ---[ end trace 0000000000000000 ]--- <6> [235.280013] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.280084] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.280090] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.281319] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.281424] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.281531] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.281788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.281882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.281979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.282070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.282163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.282250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.282338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.282426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.282511] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.282609] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.282740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.283760] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.293665] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.293914] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.294933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.295020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.295097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.295175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.295250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.295326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.295405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.295483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.295561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.295638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.295736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.295837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.295914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.295989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.296065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.296138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.296213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.296288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.296362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.296444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.296527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.296609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.296705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.296796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.296877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.296957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.297035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.297116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.297197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.297276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.297354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.297434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.297519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.297609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.297711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.297802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.297884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.297962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.298040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.298117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.298198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.298278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.298361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.298444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.298528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.298607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.298700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.298790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.298870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.298949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.299029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.299114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.299195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.299276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.299356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.299435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.299512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.299590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.299685] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.299825] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.299830] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46755, lrc_seqno=46755, guc_id=0, flags=0x73 in no process [-1] <7> [235.299832] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.299891] ------------[ cut here ]------------ <4> [235.299893] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.299894] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:10/2392 <4> [235.299966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.300032] autofs4 [last unloaded: snd_hda_intel] <4> [235.300036] CPU: 7 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.300039] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.300040] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.300042] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.300047] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.300118] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.300119] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.300121] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.300123] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.300124] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.300125] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.300127] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.300128] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.300130] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.300131] CR2: 000000c000442000 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [235.300133] PKRU: 55555554 <4> [235.300134] Call Trace: <4> [235.300135] <TASK> <4> [235.300139] ? lock_sync+0x100/0x100 <4> [235.300143] ? lock_release+0xd0/0x2b0 <4> [235.300149] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.300154] process_one_work+0x239/0x760 <4> [235.300161] worker_thread+0x200/0x3f0 <4> [235.300163] ? __pfx_worker_thread+0x10/0x10 <4> [235.300166] kthread+0x10d/0x150 <4> [235.300169] ? __pfx_kthread+0x10/0x10 <4> [235.300172] ret_from_fork+0x3d4/0x480 <4> [235.300174] ? __pfx_kthread+0x10/0x10 <4> [235.300178] ret_from_fork_asm+0x1a/0x30 <4> [235.300185] </TASK> <4> [235.300186] irq event stamp: 175911 <4> [235.300187] hardirqs last enabled at (175917): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.300191] hardirqs last disabled at (175922): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.300193] softirqs last enabled at (175068): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.300195] softirqs last disabled at (175047): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.300197] ---[ end trace 0000000000000000 ]--- <5> [235.301420] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46810, lrc_seqno=46810, guc_id=0, flags=0x73 in no process [-1] <7> [235.301423] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.301486] ------------[ cut here ]------------ <4> [235.301487] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.301489] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:10/2392 <4> [235.301560] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.301624] autofs4 [last unloaded: snd_hda_intel] <4> [235.301628] CPU: 7 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.301630] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.301631] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.301632] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.301637] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.301730] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.301732] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.301736] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.301739] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.301741] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.301743] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.301745] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.301748] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [235.301750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.301753] CR2: 000000c000442000 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [235.301755] PKRU: 55555554 <4> [235.301757] Call Trace: <4> [235.301759] <TASK> <4> [235.301766] ? lock_sync+0x100/0x100 <4> [235.301774] ? lock_release+0xd0/0x2b0 <4> [235.301783] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.301793] process_one_work+0x239/0x760 <4> [235.301805] worker_thread+0x200/0x3f0 <4> [235.301810] ? __pfx_worker_thread+0x10/0x10 <4> [235.301814] kthread+0x10d/0x150 <4> [235.301818] ? __pfx_kthread+0x10/0x10 <4> [235.301824] ret_from_fork+0x3d4/0x480 <4> [235.301827] ? __pfx_kthread+0x10/0x10 <4> [235.301833] ret_from_fork_asm+0x1a/0x30 <4> [235.301846] </TASK> <4> [235.301848] irq event stamp: 177841 <4> [235.301850] hardirqs last enabled at (177847): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.301854] hardirqs last disabled at (177852): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.301858] softirqs last enabled at (177680): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.301862] softirqs last disabled at (177665): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.301866] ---[ end trace 0000000000000000 ]--- <6> [235.301877] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [235.301895] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [235.301982] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.301990] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.302014] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.302122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.302330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.302422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.302519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.302613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.302713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.302801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.302886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.302974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.303057] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.303151] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.303268] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.304282] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.314650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.314926] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.315957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.316038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.316116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.316194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.316271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.316347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.316422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.316497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.316571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.316649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.316726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.316800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.316873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.316947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.317020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.317094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.317167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.317241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.317314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.317398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.317481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.317562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.317690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.317768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.317847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.317928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.318008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.318091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.318173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.318252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.318331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.318411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.318494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.318578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.318667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.318749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.318835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.318916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.318997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.319074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.319156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.319235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.319315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.319396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.319480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.319560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.319638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.319730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.319808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.319885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.319961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.320044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.320127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.320208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.320287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.320366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.320443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.320520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.320600] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.320742] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.320747] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46810, lrc_seqno=46810, guc_id=0, flags=0x73 in no process [-1] <7> [235.320750] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.320809] ------------[ cut here ]------------ <4> [235.320810] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.320811] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [235.320883] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.320948] autofs4 [last unloaded: snd_hda_intel] <4> [235.320952] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.320955] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.320956] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.320958] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.320963] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.321033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.321035] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.321037] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.321039] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.321040] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.321041] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.321043] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.321044] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.321046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.321047] CR2: 0000733a3e633000 CR3: 000000011f50b004 CR4: 0000000000f72ef0 <4> [235.321048] PKRU: 55555554 <4> [235.321050] Call Trace: <4> [235.321051] <TASK> <4> [235.321055] ? lock_sync+0x100/0x100 <4> [235.321059] ? lock_release+0xd0/0x2b0 <4> [235.321065] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.321071] process_one_work+0x239/0x760 <4> [235.321077] worker_thread+0x200/0x3f0 <4> [235.321080] ? __pfx_worker_thread+0x10/0x10 <4> [235.321082] kthread+0x10d/0x150 <4> [235.321085] ? __pfx_kthread+0x10/0x10 <4> [235.321089] ret_from_fork+0x3d4/0x480 <4> [235.321091] ? __pfx_kthread+0x10/0x10 <4> [235.321094] ret_from_fork_asm+0x1a/0x30 <4> [235.321101] </TASK> <4> [235.321103] irq event stamp: 652083 <4> [235.321104] hardirqs last enabled at (652089): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.321107] hardirqs last disabled at (652094): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.321109] softirqs last enabled at (651070): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.321111] softirqs last disabled at (651063): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.321114] ---[ end trace 0000000000000000 ]--- <6> [235.321115] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.321186] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.321192] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.322455] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.322561] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.322700] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.322909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.323000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.323095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.323186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.323275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.323363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.323452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.323546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.323632] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.323741] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.323858] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.324869] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.335592] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.335851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.336879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.336958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.337035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.337112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.337190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.337268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.337344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.337419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.337494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.337567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.337647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.337723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.337799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.337876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.337951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.338025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.338100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.338175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.338250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.338332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.338413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.338492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.338574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.338657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.338737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.338816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.338892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.338971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.339050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.339127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.339206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.339285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.339368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.339454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.339541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.339625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.339718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.339797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.339876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.339953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.340033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.340112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.340189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.340265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.340345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.340421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.340500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.340580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.340662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.340740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.340817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.340896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.340974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.341052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.341127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.341204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.341280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.341355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.341433] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.341545] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.341549] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46810, lrc_seqno=46810, guc_id=0, flags=0x73 in no process [-1] <7> [235.341551] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.341609] ------------[ cut here ]------------ <4> [235.341610] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.341612] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.341694] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.341759] autofs4 [last unloaded: snd_hda_intel] <4> [235.341764] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.341766] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.341768] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.341769] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.341774] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.341845] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.341847] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.341849] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.341851] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.341852] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.341853] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.341854] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.341856] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.341857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.341859] CR2: 0000749c879ca000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.341860] PKRU: 55555554 <4> [235.341861] Call Trace: <4> [235.341862] <TASK> <4> [235.341866] ? lock_sync+0x100/0x100 <4> [235.341871] ? lock_release+0xd0/0x2b0 <4> [235.341876] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.341882] process_one_work+0x239/0x760 <4> [235.341888] worker_thread+0x200/0x3f0 <4> [235.341891] ? __pfx_worker_thread+0x10/0x10 <4> [235.341893] kthread+0x10d/0x150 <4> [235.341896] ? __pfx_kthread+0x10/0x10 <4> [235.341900] ret_from_fork+0x3d4/0x480 <4> [235.341902] ? __pfx_kthread+0x10/0x10 <4> [235.341905] ret_from_fork_asm+0x1a/0x30 <4> [235.341913] </TASK> <4> [235.341914] irq event stamp: 1416085 <4> [235.341915] hardirqs last enabled at (1416091): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.341918] hardirqs last disabled at (1416096): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.341920] softirqs last enabled at (1415342): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.341923] softirqs last disabled at (1415331): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.341925] ---[ end trace 0000000000000000 ]--- <5> [235.343153] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46865, lrc_seqno=46865, guc_id=0, flags=0x73 in no process [-1] <7> [235.343157] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.343224] ------------[ cut here ]------------ <4> [235.343225] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.343227] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.343298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.343375] autofs4 [last unloaded: snd_hda_intel] <4> [235.343380] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.343382] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.343384] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.343385] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.343390] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.343460] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.343462] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.343464] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.343466] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.343467] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.343469] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.343470] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.343472] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.343473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.343475] CR2: 0000749c879ca000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.343476] PKRU: 55555554 <4> [235.343478] Call Trace: <4> [235.343479] <TASK> <4> [235.343483] ? lock_sync+0x100/0x100 <4> [235.343487] ? lock_release+0xd0/0x2b0 <4> [235.343492] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.343498] process_one_work+0x239/0x760 <4> [235.343505] worker_thread+0x200/0x3f0 <4> [235.343507] ? __pfx_worker_thread+0x10/0x10 <4> [235.343510] kthread+0x10d/0x150 <4> [235.343513] ? __pfx_kthread+0x10/0x10 <4> [235.343517] ret_from_fork+0x3d4/0x480 <4> [235.343519] ? __pfx_kthread+0x10/0x10 <4> [235.343522] ret_from_fork_asm+0x1a/0x30 <4> [235.343530] </TASK> <4> [235.343531] irq event stamp: 1417967 <4> [235.343532] hardirqs last enabled at (1417973): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.343535] hardirqs last disabled at (1417978): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.343537] softirqs last enabled at (1415342): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.343539] softirqs last disabled at (1415331): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.343542] ---[ end trace 0000000000000000 ]--- <6> [235.343543] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.343611] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.343618] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.343782] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.343886] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.343993] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.344201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.344295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.344391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.344482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.344574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.344671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.344761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.344850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.344934] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.345030] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.345149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.346157] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.356879] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.357132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.358158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.358238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.358315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.358394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.358470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.358547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.358623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.358711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.358787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.358862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.358940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.359018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.359094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.359169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.359244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.359318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.359391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.359465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.359538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.359620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.359712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.359793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.359874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.359951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.360029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.360106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.360183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.360263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.360342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.360421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.360500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.360580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.360671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.360757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.360844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.360926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.361005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.361083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.361161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.361237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.361315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.361393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.361469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.361545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.361630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.361722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.361801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.361879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.361957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.362033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.362110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.362189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.362267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.362344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.362421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.362498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.362574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.362655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.362736] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.363141] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.363146] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46865, lrc_seqno=46865, guc_id=0, flags=0x73 in no process [-1] <7> [235.363148] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.363208] ------------[ cut here ]------------ <4> [235.363209] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.363211] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.363284] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.363350] autofs4 [last unloaded: snd_hda_intel] <4> [235.363354] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.363357] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.363358] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.363360] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.363365] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.363434] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.363436] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.363439] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.363440] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.363441] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.363442] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.363444] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.363445] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.363447] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.363448] CR2: 0000749c879c5000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.363449] PKRU: 55555554 <4> [235.363451] Call Trace: <4> [235.363452] <TASK> <4> [235.363456] ? lock_sync+0x100/0x100 <4> [235.363460] ? lock_release+0xd0/0x2b0 <4> [235.363466] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.363472] process_one_work+0x239/0x760 <4> [235.363478] worker_thread+0x200/0x3f0 <4> [235.363480] ? __pfx_worker_thread+0x10/0x10 <4> [235.363483] kthread+0x10d/0x150 <4> [235.363486] ? __pfx_kthread+0x10/0x10 <4> [235.363489] ret_from_fork+0x3d4/0x480 <4> [235.363491] ? __pfx_kthread+0x10/0x10 <4> [235.363495] ret_from_fork_asm+0x1a/0x30 <4> [235.363502] </TASK> <4> [235.363503] irq event stamp: 655631 <4> [235.363504] hardirqs last enabled at (655637): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.363507] hardirqs last disabled at (655642): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.363510] softirqs last enabled at (654598): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.363512] softirqs last disabled at (654591): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.363514] ---[ end trace 0000000000000000 ]--- <6> [235.363516] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.363586] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.363592] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.364830] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.364933] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.365038] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.365242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.365332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.365426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.365514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.365602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.365713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.365801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.365889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.365976] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.366076] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.366195] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.367203] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.377650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.377900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.378893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.378974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.379051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.379129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.379205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.379280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.379357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.379433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.379508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.379583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.379662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.379738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.379813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.379888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.379963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.380039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.380113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.380187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.380261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.380344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.380425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.380509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.380592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.380678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.380756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.380834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.380910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.380991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.381075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.381156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.381238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.381319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.381404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.381492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.381577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.381666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.381747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.381824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.381901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.381979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.382058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.382136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.382214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.382295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.382379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.382459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.382538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.382615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.382701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.382777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.382853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.382931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.383007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.383084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.383159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.383235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.383309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.383385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.383463] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.383577] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.383581] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46865, lrc_seqno=46865, guc_id=0, flags=0x73 in no process [-1] <7> [235.383583] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.383642] ------------[ cut here ]------------ <4> [235.383646] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.383647] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.383718] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.383783] autofs4 [last unloaded: snd_hda_intel] <4> [235.383787] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.383790] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.383791] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.383792] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.383798] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.383869] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.383870] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.383873] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.383874] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.383875] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.383877] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.383878] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.383879] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.383881] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.383882] CR2: 0000749c879ca000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.383884] PKRU: 55555554 <4> [235.383885] Call Trace: <4> [235.383886] <TASK> <4> [235.383890] ? lock_sync+0x100/0x100 <4> [235.383894] ? lock_release+0xd0/0x2b0 <4> [235.383900] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.383905] process_one_work+0x239/0x760 <4> [235.383912] worker_thread+0x200/0x3f0 <4> [235.383915] ? __pfx_worker_thread+0x10/0x10 <4> [235.383917] kthread+0x10d/0x150 <4> [235.383920] ? __pfx_kthread+0x10/0x10 <4> [235.383923] ret_from_fork+0x3d4/0x480 <4> [235.383925] ? __pfx_kthread+0x10/0x10 <4> [235.383929] ret_from_fork_asm+0x1a/0x30 <4> [235.383936] </TASK> <4> [235.383937] irq event stamp: 1422301 <4> [235.383938] hardirqs last enabled at (1422307): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.383941] hardirqs last disabled at (1422312): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.383943] softirqs last enabled at (1421392): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.383946] softirqs last disabled at (1421385): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.383948] ---[ end trace 0000000000000000 ]--- <5> [235.384400] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46920, lrc_seqno=46920, guc_id=0, flags=0x73 in no process [-1] <7> [235.384412] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.384850] ------------[ cut here ]------------ <4> [235.384853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.384854] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:3/191 <4> [235.384974] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.385047] autofs4 [last unloaded: snd_hda_intel] <4> [235.385052] CPU: 10 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.385055] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.385056] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.385058] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.385066] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.385143] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.385144] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.385147] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.385149] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.385150] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.385151] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.385152] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.385154] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.385155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.385157] CR2: 0000749c879c5000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.385158] PKRU: 55555554 <4> [235.385160] Call Trace: <4> [235.385161] <TASK> <4> [235.385165] ? lock_sync+0x100/0x100 <4> [235.385172] ? lock_release+0xd0/0x2b0 <4> [235.385179] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.385184] process_one_work+0x239/0x760 <4> [235.385190] worker_thread+0x200/0x3f0 <4> [235.385193] ? __pfx_worker_thread+0x10/0x10 <4> [235.385195] kthread+0x10d/0x150 <4> [235.385198] ? __pfx_kthread+0x10/0x10 <4> [235.385202] ret_from_fork+0x3d4/0x480 <4> [235.385204] ? __pfx_kthread+0x10/0x10 <4> [235.385207] ret_from_fork_asm+0x1a/0x30 <4> [235.385214] </TASK> <4> [235.385216] irq event stamp: 1424201 <4> [235.385217] hardirqs last enabled at (1424207): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.385219] hardirqs last disabled at (1424212): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.385222] softirqs last enabled at (1423436): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.385224] softirqs last disabled at (1423407): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.385226] ---[ end trace 0000000000000000 ]--- <6> [235.385228] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.385299] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.385305] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.385286] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.385399] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.385506] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.385718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.385808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.385903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.385992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.386081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.386169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.386258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.386347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.386433] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.386529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.386652] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.387663] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.397653] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.397903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.398940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.399021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.399097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.399176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.399252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.399330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.399406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.399484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.399562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.399638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.399732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.399806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.399881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.399955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.400029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.400103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.400175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.400249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.400323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.400404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.400486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.400569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.400659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.400740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.400818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.400894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.400971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.401051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.401131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.401209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.401289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.401368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.401452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.401536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.401620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.401711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.401790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.401869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.401951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.402030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.402110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.402190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.402267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.402342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.402422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.402499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.402581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.402664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.402744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.402820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.402897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.402977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.403054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.403132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.403208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.403286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.403362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.403438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.403517] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.403630] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.403634] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46920, lrc_seqno=46920, guc_id=0, flags=0x73 in no process [-1] <7> [235.403637] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.403717] ------------[ cut here ]------------ <4> [235.403718] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.403719] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:10/2392 <4> [235.403791] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.403856] autofs4 [last unloaded: snd_hda_intel] <4> [235.403860] CPU: 5 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.403864] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.403865] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.403866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.403871] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.403941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.403943] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.403945] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.403946] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.403948] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.403949] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.403950] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.403952] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [235.403953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.403955] CR2: 0000749c879c9000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.403956] PKRU: 55555554 <4> [235.403957] Call Trace: <4> [235.403958] <TASK> <4> [235.403962] ? lock_sync+0x100/0x100 <4> [235.403967] ? lock_release+0xd0/0x2b0 <4> [235.403972] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.403978] process_one_work+0x239/0x760 <4> [235.403984] worker_thread+0x200/0x3f0 <4> [235.403987] ? __pfx_worker_thread+0x10/0x10 <4> [235.403989] kthread+0x10d/0x150 <4> [235.403992] ? __pfx_kthread+0x10/0x10 <4> [235.403996] ret_from_fork+0x3d4/0x480 <4> [235.403998] ? __pfx_kthread+0x10/0x10 <4> [235.404001] ret_from_fork_asm+0x1a/0x30 <4> [235.404009] </TASK> <4> [235.404010] irq event stamp: 183679 <4> [235.404011] hardirqs last enabled at (183685): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.404014] hardirqs last disabled at (183690): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.404016] softirqs last enabled at (182764): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.404018] softirqs last disabled at (182757): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.404021] ---[ end trace 0000000000000000 ]--- <6> [235.404022] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.404093] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.404099] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.404508] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.404716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.404806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.404899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.404987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.405074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.405160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.405247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.405334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.405419] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.405517] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.405634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.406661] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.417384] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.417634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.418695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.418776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.418853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.418931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.419009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.419086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.419163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.419238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.419314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.419392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.419469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.419546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.419623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.419712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.419787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.419863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.419939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.420016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.420092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.420175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.420256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.420335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.420415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.420493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.420571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.420653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.420734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.420814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.420894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.420973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.421052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.421131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.421216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.421299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.421383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.421464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.421544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.421621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.421707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.421786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.421869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.421950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.422028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.422106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.422188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.422265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.422341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.422417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.422494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.422574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.422656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.422737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.422816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.422894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.422971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.423049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.423126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.423201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.423280] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.423391] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.423395] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46920, lrc_seqno=46920, guc_id=0, flags=0x73 in no process [-1] <7> [235.423397] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.423455] ------------[ cut here ]------------ <4> [235.423456] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.423458] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:10/2392 <4> [235.423530] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.423594] autofs4 [last unloaded: snd_hda_intel] <4> [235.423597] CPU: 5 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.423600] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.423602] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.423603] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.423608] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.423691] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.423693] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.423696] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.423697] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.423699] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.423700] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.423701] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.423703] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [235.423704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.423706] CR2: 0000749c879c9000 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [235.423707] PKRU: 55555554 <4> [235.423708] Call Trace: <4> [235.423709] <TASK> <4> [235.423713] ? lock_sync+0x100/0x100 <4> [235.423718] ? lock_release+0xd0/0x2b0 <4> [235.423723] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.423729] process_one_work+0x239/0x760 <4> [235.423735] worker_thread+0x200/0x3f0 <4> [235.423738] ? __pfx_worker_thread+0x10/0x10 <4> [235.423741] kthread+0x10d/0x150 <4> [235.423744] ? __pfx_kthread+0x10/0x10 <4> [235.423748] ret_from_fork+0x3d4/0x480 <4> [235.423750] ? __pfx_kthread+0x10/0x10 <4> [235.423753] ret_from_fork_asm+0x1a/0x30 <4> [235.423761] </TASK> <4> [235.423762] irq event stamp: 186845 <4> [235.423763] hardirqs last enabled at (186851): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.423766] hardirqs last disabled at (186856): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.423768] softirqs last enabled at (185948): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.423771] softirqs last disabled at (185941): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.423773] ---[ end trace 0000000000000000 ]--- <7> [235.424814] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.424923] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.425109] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46975, lrc_seqno=46975, guc_id=0, flags=0x73 in no process [-1] <7> [235.425113] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.425196] ------------[ cut here ]------------ <4> [235.425197] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.425198] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.425274] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.425339] autofs4 [last unloaded: snd_hda_intel] <4> [235.425343] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.425346] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.425347] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.425348] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.425354] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.425426] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.425428] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.425430] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.425431] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.425433] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.425434] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.425435] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.425436] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.425438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.425439] CR2: 0000733a3e633000 CR3: 000000011f50b004 CR4: 0000000000f72ef0 <4> [235.425441] PKRU: 55555554 <4> [235.425442] Call Trace: <4> [235.425443] <TASK> <4> [235.425447] ? lock_sync+0x100/0x100 <4> [235.425452] ? lock_release+0xd0/0x2b0 <4> [235.425457] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.425463] process_one_work+0x239/0x760 <4> [235.425469] worker_thread+0x200/0x3f0 <4> [235.425472] ? __pfx_worker_thread+0x10/0x10 <4> [235.425474] kthread+0x10d/0x150 <4> [235.425477] ? __pfx_kthread+0x10/0x10 <4> [235.425481] ret_from_fork+0x3d4/0x480 <4> [235.425483] ? __pfx_kthread+0x10/0x10 <4> [235.425486] ret_from_fork_asm+0x1a/0x30 <4> [235.425494] </TASK> <4> [235.425495] irq event stamp: 188745 <4> [235.425496] hardirqs last enabled at (188751): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.425499] hardirqs last disabled at (188756): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.425501] softirqs last enabled at (185948): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.425504] softirqs last disabled at (185941): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.425506] ---[ end trace 0000000000000000 ]--- <6> [235.425508] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.425579] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.425588] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.425715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.425978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.426116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.426255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.426387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.426520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.426660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.426804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.426907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.426999] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.427098] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.427215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.428244] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.438652] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.438902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.440061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.440193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.440315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.440438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.440559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.440688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.440810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.440931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.441052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.441172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.441292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.441413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.441534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.441670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.441751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.441831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.441910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.441986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.442061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.442145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.442227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.442308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.442391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.442472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.442551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.442629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.442719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.442799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.442880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.442958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.443037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.443116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.443200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.443284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.443368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.443449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.443533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.443615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.443704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.443784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.443866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.443947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.444027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.444105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.444185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.444261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.444340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.444423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.444505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.444584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.444663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.444744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.444821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.444899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.444976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.445055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.445131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.445207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.445287] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.445401] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.445405] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46975, lrc_seqno=46975, guc_id=0, flags=0x73 in no process [-1] <7> [235.445407] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.445466] ------------[ cut here ]------------ <4> [235.445467] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.445469] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.445541] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.445605] autofs4 [last unloaded: snd_hda_intel] <4> [235.445609] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.445612] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.445613] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.445614] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.445619] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.445699] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.445701] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.445703] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.445705] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.445706] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.445708] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.445709] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.445711] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.445712] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.445714] CR2: 0000749c879ca000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.445715] PKRU: 55555554 <4> [235.445716] Call Trace: <4> [235.445717] <TASK> <4> [235.445721] ? lock_sync+0x100/0x100 <4> [235.445726] ? lock_release+0xd0/0x2b0 <4> [235.445731] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.445737] process_one_work+0x239/0x760 <4> [235.445743] worker_thread+0x200/0x3f0 <4> [235.445746] ? __pfx_worker_thread+0x10/0x10 <4> [235.445748] kthread+0x10d/0x150 <4> [235.445751] ? __pfx_kthread+0x10/0x10 <4> [235.445755] ret_from_fork+0x3d4/0x480 <4> [235.445757] ? __pfx_kthread+0x10/0x10 <4> [235.445760] ret_from_fork_asm+0x1a/0x30 <4> [235.445768] </TASK> <4> [235.445769] irq event stamp: 1428711 <4> [235.445770] hardirqs last enabled at (1428717): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.445773] hardirqs last disabled at (1428722): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.445775] softirqs last enabled at (1428550): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.445778] softirqs last disabled at (1428545): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.445780] ---[ end trace 0000000000000000 ]--- <6> [235.445781] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.445851] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.445857] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.446980] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.447086] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.447191] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.447396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.447489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.447583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.447676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.447764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.447850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.447936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.448023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.448108] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.448205] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.448323] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.449331] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.459654] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.459905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.460933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.461012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.461089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.461167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.461246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.461325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.461401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.461476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.461551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.461625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.461711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.461784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.461859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.461934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.462008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.462082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.462156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.462230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.462305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.462387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.462468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.462549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.462632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.462725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.462804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.462881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.462957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.463036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.463116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.463194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.463273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.463353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.463437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.463521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.463606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.463694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.463774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.463851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.463928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.464004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.464082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.464160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.464238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.464319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.464402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.464481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.464557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.464634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.464724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.464800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.464877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.464956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.465038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.465120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.465198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.465278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.465357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.465434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.465514] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.465627] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.465631] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46975, lrc_seqno=46975, guc_id=0, flags=0x73 in no process [-1] <7> [235.465634] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.465722] ------------[ cut here ]------------ <4> [235.465723] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.465724] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:1/120 <4> [235.465795] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.465861] autofs4 [last unloaded: snd_hda_intel] <4> [235.465865] CPU: 2 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.465868] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.465869] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.465870] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.465876] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.465945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.465947] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.465949] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.465951] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.465952] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.465953] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.465954] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.465956] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.465957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.465959] CR2: 0000733a3e633000 CR3: 000000011f50b004 CR4: 0000000000f72ef0 <4> [235.465960] PKRU: 55555554 <4> [235.465961] Call Trace: <4> [235.465963] <TASK> <4> [235.465967] ? lock_sync+0x100/0x100 <4> [235.465971] ? lock_release+0xd0/0x2b0 <4> [235.465977] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.465983] process_one_work+0x239/0x760 <4> [235.465989] worker_thread+0x200/0x3f0 <4> [235.465992] ? __pfx_worker_thread+0x10/0x10 <4> [235.465994] kthread+0x10d/0x150 <4> [235.465997] ? __pfx_kthread+0x10/0x10 <4> [235.466001] ret_from_fork+0x3d4/0x480 <4> [235.466003] ? __pfx_kthread+0x10/0x10 <4> [235.466006] ret_from_fork_asm+0x1a/0x30 <4> [235.466014] </TASK> <4> [235.466015] irq event stamp: 660177 <4> [235.466016] hardirqs last enabled at (660183): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.466019] hardirqs last disabled at (660188): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.466021] softirqs last enabled at (659416): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.466024] softirqs last disabled at (659361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.466026] ---[ end trace 0000000000000000 ]--- <5> [235.467120] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47030, lrc_seqno=47030, guc_id=0, flags=0x73 in no process [-1] <7> [235.467129] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.467234] ------------[ cut here ]------------ <4> [235.467235] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.467237] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/120 <4> [235.467313] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake <7> [235.467321] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [235.467375] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [235.467385] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.467387] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.467388] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.467389] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.467395] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.467466] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.467468] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.467470] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.467472] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.467473] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.467474] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.467476] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.467477] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <7> [235.467430] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [235.467479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.467480] CR2: 0000749c879cc000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.467482] PKRU: 55555554 <4> [235.467483] Call Trace: <4> [235.467484] <TASK> <4> [235.467487] ? lock_sync+0x100/0x100 <4> [235.467492] ? lock_release+0xd0/0x2b0 <4> [235.467497] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.467503] process_one_work+0x239/0x760 <4> [235.467509] worker_thread+0x200/0x3f0 <4> [235.467511] ? __pfx_worker_thread+0x10/0x10 <4> [235.467513] kthread+0x10d/0x150 <4> [235.467516] ? __pfx_kthread+0x10/0x10 <4> [235.467519] ret_from_fork+0x3d4/0x480 <4> [235.467521] ? __pfx_kthread+0x10/0x10 <4> [235.467524] ret_from_fork_asm+0x1a/0x30 <4> [235.467531] </TASK> <4> [235.467533] irq event stamp: 662059 <4> [235.467534] hardirqs last enabled at (662065): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.467537] hardirqs last disabled at (662070): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.467539] softirqs last enabled at (659416): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.467541] softirqs last disabled at (659361): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.467544] ---[ end trace 0000000000000000 ]--- <6> [235.467546] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.467615] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.467622] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.467678] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.468019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.468110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.468206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.468297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.468385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.468472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.468558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.468652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.468736] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.468829] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.468946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.469956] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.480655] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.480906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.481933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.482013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.482092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.482171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.482249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.482324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.482399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.482473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.482548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.482622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.482715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.482790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.482865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.482939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.483013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.483090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.483166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.483242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.483316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.483398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.483479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.483557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.483638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.483734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.483812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.483890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.483969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.484050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.484135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.484214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.484294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.484373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.484457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.484541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.484625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.484715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.484795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.484873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.484951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.485027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.485111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.485193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.485273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.485351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.485432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.485508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.485585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.485664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.485742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.485821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.485901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.485982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.486060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.486138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.486215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.486293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.486369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.486445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.486525] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.486637] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.486641] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47030, lrc_seqno=47030, guc_id=0, flags=0x73 in no process [-1] <7> [235.486643] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.487567] ------------[ cut here ]------------ <4> [235.487569] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.487570] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/120 <4> [235.487648] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.487731] autofs4 [last unloaded: snd_hda_intel] <4> [235.487736] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.487738] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.487740] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.487741] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.487746] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.487817] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.487819] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.487821] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.487823] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.487824] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.487825] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.487826] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.487828] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.487829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.487831] CR2: 0000749c879cc000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.487832] PKRU: 55555554 <4> [235.487833] Call Trace: <4> [235.487835] <TASK> <4> [235.487838] ? lock_sync+0x100/0x100 <4> [235.487843] ? lock_release+0xd0/0x2b0 <4> [235.487848] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.487854] process_one_work+0x239/0x760 <4> [235.487860] worker_thread+0x200/0x3f0 <4> [235.487863] ? __pfx_worker_thread+0x10/0x10 <4> [235.487865] kthread+0x10d/0x150 <4> [235.487868] ? __pfx_kthread+0x10/0x10 <4> [235.487872] ret_from_fork+0x3d4/0x480 <4> [235.487874] ? __pfx_kthread+0x10/0x10 <4> [235.487877] ret_from_fork_asm+0x1a/0x30 <4> [235.487885] </TASK> <4> [235.487886] irq event stamp: 665203 <4> [235.487887] hardirqs last enabled at (665209): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.487890] hardirqs last disabled at (665214): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.487892] softirqs last enabled at (664194): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.487894] softirqs last disabled at (664187): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.487896] ---[ end trace 0000000000000000 ]--- <6> [235.487898] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.487968] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.487974] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.487990] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.488096] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.488381] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.488588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.488710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.488806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.488899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.488988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.489075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.489160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.489247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.489330] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.489425] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.489542] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.490548] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.500659] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.500908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.501937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.502018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.502097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.502175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.502255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.502332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.502409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.502485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.502559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.502634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.502722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.502799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.502875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.502949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.503024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.503097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.503171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.503245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.503320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.503402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.503483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.503562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.503651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.503732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.503811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.503889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.503966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.504045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.504126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.504204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.504284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.504363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.504446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.504529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.504614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.504706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.504789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.504868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.504946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.505022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.505102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.505179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.505257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.505333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.505413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.505493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.505572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.505653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.505732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.505808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.505883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.505962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.506038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.506115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.506191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.506268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.506347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.506426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.506507] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.506619] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.506623] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47030, lrc_seqno=47030, guc_id=0, flags=0x73 in no process [-1] <7> [235.506625] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.506701] ------------[ cut here ]------------ <4> [235.506702] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.506704] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/2392 <4> [235.506776] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.506840] autofs4 [last unloaded: snd_hda_intel] <4> [235.506844] CPU: 10 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.506847] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.506848] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.506850] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.506855] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.506924] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.506926] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.506928] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.506930] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.506931] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.506932] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.506933] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.506935] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.506936] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.506938] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.506939] PKRU: 55555554 <4> [235.506940] Call Trace: <4> [235.506941] <TASK> <4> [235.506945] ? lock_sync+0x100/0x100 <4> [235.506950] ? lock_release+0xd0/0x2b0 <4> [235.506956] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.506961] process_one_work+0x239/0x760 <4> [235.506967] worker_thread+0x200/0x3f0 <4> [235.506970] ? __pfx_worker_thread+0x10/0x10 <4> [235.506973] kthread+0x10d/0x150 <4> [235.506975] ? __pfx_kthread+0x10/0x10 <4> [235.506979] ret_from_fork+0x3d4/0x480 <4> [235.506981] ? __pfx_kthread+0x10/0x10 <4> [235.506985] ret_from_fork_asm+0x1a/0x30 <4> [235.506992] </TASK> <4> [235.506993] irq event stamp: 194963 <4> [235.506994] hardirqs last enabled at (194969): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.506997] hardirqs last disabled at (194974): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.506999] softirqs last enabled at (194202): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.507002] softirqs last disabled at (194195): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.507004] ---[ end trace 0000000000000000 ]--- <5> [235.508211] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47085, lrc_seqno=47085, guc_id=0, flags=0x73 in no process [-1] <7> [235.508214] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.508276] ------------[ cut here ]------------ <4> [235.508277] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.508278] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:10/2392 <4> [235.508348] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.508412] autofs4 [last unloaded: snd_hda_intel] <4> [235.508416] CPU: 10 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.508418] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.508419] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.508421] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.508426] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.508495] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.508497] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.508499] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.508500] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.508501] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.508503] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.508504] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.508505] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.508507] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.508508] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.508509] PKRU: 55555554 <4> [235.508510] Call Trace: <4> [235.508511] <TASK> <4> [235.508515] ? lock_sync+0x100/0x100 <4> [235.508519] ? lock_release+0xd0/0x2b0 <4> [235.508525] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.508530] process_one_work+0x239/0x760 <4> [235.508536] worker_thread+0x200/0x3f0 <4> [235.508539] ? __pfx_worker_thread+0x10/0x10 <4> [235.508541] kthread+0x10d/0x150 <4> [235.508544] ? __pfx_kthread+0x10/0x10 <4> [235.508548] ret_from_fork+0x3d4/0x480 <4> [235.508549] ? __pfx_kthread+0x10/0x10 <4> [235.508553] ret_from_fork_asm+0x1a/0x30 <4> [235.508560] </TASK> <4> [235.508561] irq event stamp: 196845 <4> [235.508562] hardirqs last enabled at (196851): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.508565] hardirqs last disabled at (196856): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.508567] softirqs last enabled at (194202): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.508570] softirqs last disabled at (194195): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.508572] ---[ end trace 0000000000000000 ]--- <6> [235.508573] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.508649] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.508655] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.508841] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.508947] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.509052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.509260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.509354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.509448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.509539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.509628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.509730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.509817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.509909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.509996] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.510094] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.510211] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.511218] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.521661] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.521911] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.522936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.523016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.523093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.523171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.523248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.523325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.523401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.523476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.523550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.523623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.523707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.523781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.523857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.523935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.524010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.524085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.524159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.524233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.524307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.524390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.524472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.524551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.524629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.524718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.524794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.524872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.524951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.525034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.525119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.525201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.525282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.525363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.525448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.525532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.525617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.525710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.525796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.525878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.525958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.526039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.526122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.526203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.526282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.526359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.526440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.526518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.526596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.526680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.526763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.526843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.526920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.527002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.527080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.527158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.527239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.527322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.527401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.527479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.527560] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.527676] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.527698] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47085, lrc_seqno=47085, guc_id=0, flags=0x73 in no process [-1] <7> [235.527700] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.527760] ------------[ cut here ]------------ <4> [235.527761] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.527762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.527837] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.527902] autofs4 [last unloaded: snd_hda_intel] <4> [235.527906] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.527909] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.527910] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.527912] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.527917] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.527987] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.527988] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.527991] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.527992] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.527993] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.527995] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.527996] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.527997] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.527999] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.528000] CR2: 0000749c879ca000 CR3: 0000000122e3e003 CR4: 0000000000f72ef0 <4> [235.528001] PKRU: 55555554 <4> [235.528003] Call Trace: <4> [235.528004] <TASK> <4> [235.528008] ? lock_sync+0x100/0x100 <4> [235.528012] ? lock_release+0xd0/0x2b0 <4> [235.528018] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.528023] process_one_work+0x239/0x760 <4> [235.528030] worker_thread+0x200/0x3f0 <4> [235.528032] ? __pfx_worker_thread+0x10/0x10 <4> [235.528035] kthread+0x10d/0x150 <4> [235.528038] ? __pfx_kthread+0x10/0x10 <4> [235.528041] ret_from_fork+0x3d4/0x480 <4> [235.528043] ? __pfx_kthread+0x10/0x10 <4> [235.528046] ret_from_fork_asm+0x1a/0x30 <4> [235.528054] </TASK> <4> [235.528055] irq event stamp: 1433049 <4> [235.528056] hardirqs last enabled at (1433055): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.528059] hardirqs last disabled at (1433060): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.528061] softirqs last enabled at (1432046): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.528064] softirqs last disabled at (1432039): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.528066] ---[ end trace 0000000000000000 ]--- <6> [235.528068] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.528137] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.528143] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.529379] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.529485] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.529592] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.529819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.529912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.530007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.530098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.530189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.530279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.530366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.530455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.530539] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.530635] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.530766] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.531779] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.541654] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.541902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.542930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.543010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.543087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.543165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.543243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.543322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.543398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.543473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.543549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.543624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.543707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.543782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.543858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.543936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.544013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.544090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.544167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.544246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.544324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.544406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.544488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.544568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.544657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.544738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.544817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.544895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.544972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.545051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.545131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.545209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.545289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.545373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.545460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.545546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.545631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.545725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.545806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.545884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.545962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.546038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.546118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.546199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.546281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.546360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.546445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.546522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.546601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.546685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.546763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.546838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.546918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.547000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.547080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.547158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.547234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.547312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.547388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.547464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.547544] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.547660] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.547664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47085, lrc_seqno=47085, guc_id=0, flags=0x73 in no process [-1] <7> [235.547666] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.547740] ------------[ cut here ]------------ <4> [235.547741] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.547743] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/120 <4> [235.547816] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.547881] autofs4 [last unloaded: snd_hda_intel] <4> [235.547885] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.547888] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.547889] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.547890] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.547896] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.547966] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.547968] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.547970] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.547971] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.547973] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.547974] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.547975] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.547977] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.547978] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.547979] CR2: 0000749c879cc000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.547981] PKRU: 55555554 <4> [235.547982] Call Trace: <4> [235.547983] <TASK> <4> [235.547987] ? lock_sync+0x100/0x100 <4> [235.547992] ? lock_release+0xd0/0x2b0 <4> [235.547997] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.548003] process_one_work+0x239/0x760 <4> [235.548009] worker_thread+0x200/0x3f0 <4> [235.548012] ? __pfx_worker_thread+0x10/0x10 <4> [235.548014] kthread+0x10d/0x150 <4> [235.548017] ? __pfx_kthread+0x10/0x10 <4> [235.548021] ret_from_fork+0x3d4/0x480 <4> [235.548023] ? __pfx_kthread+0x10/0x10 <4> [235.548026] ret_from_fork_asm+0x1a/0x30 <4> [235.548033] </TASK> <4> [235.548034] irq event stamp: 668609 <4> [235.548036] hardirqs last enabled at (668615): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.548038] hardirqs last disabled at (668620): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.548041] softirqs last enabled at (667606): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.548043] softirqs last disabled at (667599): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.548045] ---[ end trace 0000000000000000 ]--- <5> [235.549279] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47140, lrc_seqno=47140, guc_id=0, flags=0x73 in no process [-1] <7> [235.549282] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.549346] ------------[ cut here ]------------ <4> [235.549347] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.549348] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/120 <4> [235.549420] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.549485] autofs4 [last unloaded: snd_hda_intel] <4> [235.549489] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.549492] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.549493] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.549494] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.549499] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.549567] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.549569] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.549571] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.549572] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.549573] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.549575] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.549576] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.549577] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.549579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.549580] CR2: 0000749c879cc000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.549581] PKRU: 55555554 <4> [235.549582] Call Trace: <4> [235.549583] <TASK> <4> [235.549587] ? lock_sync+0x100/0x100 <4> [235.549591] ? lock_release+0xd0/0x2b0 <4> [235.549596] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.549602] process_one_work+0x239/0x760 <4> [235.549608] worker_thread+0x200/0x3f0 <4> [235.549611] ? __pfx_worker_thread+0x10/0x10 <4> [235.549613] kthread+0x10d/0x150 <4> [235.549616] ? __pfx_kthread+0x10/0x10 <4> [235.549619] ret_from_fork+0x3d4/0x480 <4> [235.549621] ? __pfx_kthread+0x10/0x10 <4> [235.549625] ret_from_fork_asm+0x1a/0x30 <4> [235.549632] </TASK> <4> [235.549633] irq event stamp: 670503 <4> [235.549634] hardirqs last enabled at (670509): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.549637] hardirqs last disabled at (670514): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.549639] softirqs last enabled at (667606): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.549641] softirqs last disabled at (667599): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.549643] ---[ end trace 0000000000000000 ]--- <6> [235.549649] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.549718] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.549725] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.549884] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.549990] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.550096] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.550305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.550397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.550494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.550587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.550688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.550778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.550866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.550954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.551039] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.551136] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.551255] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.552263] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.562653] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.562903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.563937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.564017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.564094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.564172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.564249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.564326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.564402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.564477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.564552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.564626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.564711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.564789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.564867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.564942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.565017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.565093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.565167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.565241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.565315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.565398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.565480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.565559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.565642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.565737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.565816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.565892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.565969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.566049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.566128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.566206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.566286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.566365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.566449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.566532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.566615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.566705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.566784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.566861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.566937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.567016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.567100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.567181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.567260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.567337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.567418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.567494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.567571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.567649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.567728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.567808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.567887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.567968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.568047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.568125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.568203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.568283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.568363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.568442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.568523] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.568636] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.568640] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47140, lrc_seqno=47140, guc_id=0, flags=0x73 in no process [-1] <7> [235.568643] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.568723] ------------[ cut here ]------------ <4> [235.568725] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.568726] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.568797] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.568862] autofs4 [last unloaded: snd_hda_intel] <4> [235.568866] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.568869] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.568870] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.568871] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.568877] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.568946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.568948] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.568950] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.568951] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.568953] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.568954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.568955] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.568956] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.568958] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.568959] CR2: 0000749c879ce000 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [235.568961] PKRU: 55555554 <4> [235.568962] Call Trace: <4> [235.568963] <TASK> <4> [235.568967] ? lock_sync+0x100/0x100 <4> [235.568972] ? lock_release+0xd0/0x2b0 <4> [235.568978] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.568983] process_one_work+0x239/0x760 <4> [235.568989] worker_thread+0x200/0x3f0 <4> [235.568992] ? __pfx_worker_thread+0x10/0x10 <4> [235.568995] kthread+0x10d/0x150 <4> [235.568997] ? __pfx_kthread+0x10/0x10 <4> [235.569001] ret_from_fork+0x3d4/0x480 <4> [235.569003] ? __pfx_kthread+0x10/0x10 <4> [235.569007] ret_from_fork_asm+0x1a/0x30 <4> [235.569014] </TASK> <4> [235.569015] irq event stamp: 201933 <4> [235.569016] hardirqs last enabled at (201939): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.569019] hardirqs last disabled at (201944): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.569022] softirqs last enabled at (201172): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.569024] softirqs last disabled at (201165): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.569027] ---[ end trace 0000000000000000 ]--- <6> [235.569028] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.569098] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.569104] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.570341] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.570445] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.570551] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.570753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.570846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.570942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.571032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.571118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.571204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.571289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.571377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.571458] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.571553] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.571673] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.572679] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.582655] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.582906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.583935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.584016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.584093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.584172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.584250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.584327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.584403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.584483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.584560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.584637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.584733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.584807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.584884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.584959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.585034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.585108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.585182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.585259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.585336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.585419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.585500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.585580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.585665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.585743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.585821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.585901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.585982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.586063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.586144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.586224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.586303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.586383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.586470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.586557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.586644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.586741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.586821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.586899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.586977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.587053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.587132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.587211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.587291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.587372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.587454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.587533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.587612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.587697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.587775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.587851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.587928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.588007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.588084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.588161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.588237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.588314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.588394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.588473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.588555] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.588672] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.588676] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47140, lrc_seqno=47140, guc_id=0, flags=0x73 in no process [-1] <7> [235.588679] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.588737] ------------[ cut here ]------------ <4> [235.588739] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.588740] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:3/191 <4> [235.588812] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.588877] autofs4 [last unloaded: snd_hda_intel] <4> [235.588881] CPU: 10 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.588884] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.588885] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.588887] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.588892] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.588961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.588963] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.588965] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.588967] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.588968] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.588969] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.588970] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.588972] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.588973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.588975] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.588976] PKRU: 55555554 <4> [235.588977] Call Trace: <4> [235.588978] <TASK> <4> [235.588982] ? lock_sync+0x100/0x100 <4> [235.588987] ? lock_release+0xd0/0x2b0 <4> [235.588992] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.588998] process_one_work+0x239/0x760 <4> [235.589004] worker_thread+0x200/0x3f0 <4> [235.589007] ? __pfx_worker_thread+0x10/0x10 <4> [235.589009] kthread+0x10d/0x150 <4> [235.589012] ? __pfx_kthread+0x10/0x10 <4> [235.589016] ret_from_fork+0x3d4/0x480 <4> [235.589018] ? __pfx_kthread+0x10/0x10 <4> [235.589021] ret_from_fork_asm+0x1a/0x30 <4> [235.589029] </TASK> <4> [235.589030] irq event stamp: 1436463 <4> [235.589031] hardirqs last enabled at (1436469): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.589034] hardirqs last disabled at (1436474): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.589036] softirqs last enabled at (1435460): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.589039] softirqs last disabled at (1435455): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.589041] ---[ end trace 0000000000000000 ]--- <5> [235.590252] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47195, lrc_seqno=47195, guc_id=0, flags=0x73 in no process [-1] <7> [235.590255] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.590317] ------------[ cut here ]------------ <4> [235.590318] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.590319] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:3/191 <4> [235.590390] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.590454] autofs4 [last unloaded: snd_hda_intel] <4> [235.590458] CPU: 10 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.590460] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.590461] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.590463] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.590468] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.590538] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.590540] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.590542] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.590543] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.590544] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.590546] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.590547] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.590548] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.590550] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.590551] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.590552] PKRU: 55555554 <4> [235.590553] Call Trace: <4> [235.590555] <TASK> <4> [235.590558] ? lock_sync+0x100/0x100 <4> [235.590562] ? lock_release+0xd0/0x2b0 <4> [235.590568] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.590574] process_one_work+0x239/0x760 <4> [235.590580] worker_thread+0x200/0x3f0 <4> [235.590582] ? __pfx_worker_thread+0x10/0x10 <4> [235.590585] kthread+0x10d/0x150 <4> [235.590587] ? __pfx_kthread+0x10/0x10 <4> [235.590591] ret_from_fork+0x3d4/0x480 <4> [235.590593] ? __pfx_kthread+0x10/0x10 <4> [235.590596] ret_from_fork_asm+0x1a/0x30 <4> [235.590604] </TASK> <4> [235.590605] irq event stamp: 1438357 <4> [235.590606] hardirqs last enabled at (1438363): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.590608] hardirqs last disabled at (1438368): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.590611] softirqs last enabled at (1435460): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.590613] softirqs last disabled at (1435455): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.590615] ---[ end trace 0000000000000000 ]--- <6> [235.590617] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [235.590716] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.590821] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [235.590925] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.590931] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.590992] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.591541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.591636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.591748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.591839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.591927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.592016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.592103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.592195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.592282] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.592379] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.592497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.593508] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.603656] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.603910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.604935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.605014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.605089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.605166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.605244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.605321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.605399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.605477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.605553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.605629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.605718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.605793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.605868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.605941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.606014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.606088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.606162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.606235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.606309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.606391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.606472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.606553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.606636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.606730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.606808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.606885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.606962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.607042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.607121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.607199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.607278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.607356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.607440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.607525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.607608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.607705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.607790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.607871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.607953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.608034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.608117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.608197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.608275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.608353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.608433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.608510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.608587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.608667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.608746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.608827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.608907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.608989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.609072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.609154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.609234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.609315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.609395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.609472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.609553] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.609670] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.609674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47195, lrc_seqno=47195, guc_id=0, flags=0x73 in no process [-1] <7> [235.609677] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.609736] ------------[ cut here ]------------ <4> [235.609737] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.609739] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.609811] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.609876] autofs4 [last unloaded: snd_hda_intel] <4> [235.609880] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.609883] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.609884] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.609886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.609891] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.609961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.609963] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.609965] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.609967] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.609968] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.609969] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.609970] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.609972] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.609973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.609975] CR2: 0000749c879ce000 CR3: 0000000122e3e002 CR4: 0000000000f72ef0 <4> [235.609976] PKRU: 55555554 <4> [235.609977] Call Trace: <4> [235.609978] <TASK> <4> [235.609983] ? lock_sync+0x100/0x100 <4> [235.609987] ? lock_release+0xd0/0x2b0 <4> [235.609993] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.609998] process_one_work+0x239/0x760 <4> [235.610005] worker_thread+0x200/0x3f0 <4> [235.610007] ? __pfx_worker_thread+0x10/0x10 <4> [235.610010] kthread+0x10d/0x150 <4> [235.610013] ? __pfx_kthread+0x10/0x10 <4> [235.610016] ret_from_fork+0x3d4/0x480 <4> [235.610019] ? __pfx_kthread+0x10/0x10 <4> [235.610022] ret_from_fork_asm+0x1a/0x30 <4> [235.610029] </TASK> <4> [235.610030] irq event stamp: 205323 <4> [235.610032] hardirqs last enabled at (205329): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.610034] hardirqs last disabled at (205334): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.610036] softirqs last enabled at (204320): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.610039] softirqs last disabled at (204313): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.610041] ---[ end trace 0000000000000000 ]--- <6> [235.610043] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.610113] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.610119] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.610526] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.610733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.610822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.610916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.611004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.611091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.611175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.611261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.611348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.611430] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.611525] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.611643] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.612683] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.623407] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.623655] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.624681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.624762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.624840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.624918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.624994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.625069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.625144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.625220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.625297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.625375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.625451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.625527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.625601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.625686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.625760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.625836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.625911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.625985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.626059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.626140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.626222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.626304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.626387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.626466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.626544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.626622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.626711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.626791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.626871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.626949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.627027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.627105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.627188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.627272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.627355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.627436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.627516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.627597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.627687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.627764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.627845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.627924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.628001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.628078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.628158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.628235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.628312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.628388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.628465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.628542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.628617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.628706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.628783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.628859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.628934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.629011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.629087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.629163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.629243] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.629355] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.629359] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47195, lrc_seqno=47195, guc_id=0, flags=0x73 in no process [-1] <7> [235.629362] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.629420] ------------[ cut here ]------------ <4> [235.629421] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.629423] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.629494] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.629559] autofs4 [last unloaded: snd_hda_intel] <4> [235.629562] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.629565] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.629566] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.629568] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.629572] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.629642] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.629644] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.629651] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.629653] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.629654] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.629656] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.629657] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.629658] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.629660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.629661] CR2: 0000749c879ce000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.629663] PKRU: 55555554 <4> [235.629664] Call Trace: <4> [235.629665] <TASK> <4> [235.629670] ? lock_sync+0x100/0x100 <4> [235.629674] ? lock_release+0xd0/0x2b0 <4> [235.629679] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.629685] process_one_work+0x239/0x760 <4> [235.629691] worker_thread+0x200/0x3f0 <4> [235.629694] ? __pfx_worker_thread+0x10/0x10 <4> [235.629696] kthread+0x10d/0x150 <4> [235.629699] ? __pfx_kthread+0x10/0x10 <4> [235.629703] ret_from_fork+0x3d4/0x480 <4> [235.629705] ? __pfx_kthread+0x10/0x10 <4> [235.629708] ret_from_fork_asm+0x1a/0x30 <4> [235.629716] </TASK> <4> [235.629717] irq event stamp: 208477 <4> [235.629718] hardirqs last enabled at (208483): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.629721] hardirqs last disabled at (208488): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.629723] softirqs last enabled at (207398): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.629726] softirqs last disabled at (207389): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.629728] ---[ end trace 0000000000000000 ]--- <7> [235.631033] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.631139] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.631240] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47250, lrc_seqno=47250, guc_id=0, flags=0x73 in no process [-1] <7> [235.631242] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.631301] ------------[ cut here ]------------ <4> [235.631302] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.631304] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.631376] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.631440] autofs4 [last unloaded: snd_hda_intel] <4> [235.631444] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.631446] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.631447] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.631449] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.631454] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.631524] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.631526] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.631528] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.631529] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.631530] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.631532] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.631533] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.631534] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.631536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.631537] CR2: 0000749c879ce000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.631538] PKRU: 55555554 <4> [235.631539] Call Trace: <4> [235.631540] <TASK> <4> [235.631544] ? lock_sync+0x100/0x100 <4> [235.631548] ? lock_release+0xd0/0x2b0 <4> [235.631554] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.631559] process_one_work+0x239/0x760 <4> [235.631565] worker_thread+0x200/0x3f0 <4> [235.631568] ? __pfx_worker_thread+0x10/0x10 <4> [235.631570] kthread+0x10d/0x150 <4> [235.631573] ? __pfx_kthread+0x10/0x10 <4> [235.631577] ret_from_fork+0x3d4/0x480 <4> [235.631579] ? __pfx_kthread+0x10/0x10 <4> [235.631582] ret_from_fork_asm+0x1a/0x30 <4> [235.631589] </TASK> <4> [235.631590] irq event stamp: 210355 <4> [235.631591] hardirqs last enabled at (210361): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.631594] hardirqs last disabled at (210366): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.631596] softirqs last enabled at (207398): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.631599] softirqs last disabled at (207389): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.631601] ---[ end trace 0000000000000000 ]--- <6> [235.631603] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.631687] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.631692] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.631897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.632100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.632189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.632282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.632373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.632462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.632551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.632637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.632740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.632822] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.632916] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.633034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.634042] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.644655] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.644904] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.645899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.645978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.646057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.646136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.646213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.646289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.646365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.646440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.646513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.646587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.646663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.646736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.646809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.646886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.646963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.647040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.647115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.647189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.647263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.647344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.647426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.647505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.647585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.647666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.647744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.647821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.647898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.647982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.648066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.648146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.648225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.648305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.648390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.648474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.648558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.648638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.648731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.648812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.648893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.648972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.649052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.649132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.649210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.649288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.649368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.649445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.649522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.649598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.649681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.649760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.649841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.649924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.650003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.650082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.650160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.650239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.650316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.650393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.650473] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.650583] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.650587] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47250, lrc_seqno=47250, guc_id=0, flags=0x73 in no process [-1] <7> [235.650589] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.651524] ------------[ cut here ]------------ <4> [235.651526] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.651527] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.651600] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.651669] autofs4 [last unloaded: snd_hda_intel] <4> [235.651673] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.651675] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.651677] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.651678] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.651683] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.651753] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.651755] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.651757] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.651758] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.651759] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.651761] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.651762] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.651763] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.651765] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.651766] CR2: 0000749c879ce000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.651768] PKRU: 55555554 <4> [235.651769] Call Trace: <4> [235.651770] <TASK> <4> [235.651774] ? lock_sync+0x100/0x100 <4> [235.651778] ? lock_release+0xd0/0x2b0 <4> [235.651783] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.651789] process_one_work+0x239/0x760 <4> [235.651795] worker_thread+0x200/0x3f0 <4> [235.651798] ? __pfx_worker_thread+0x10/0x10 <4> [235.651800] kthread+0x10d/0x150 <4> [235.651803] ? __pfx_kthread+0x10/0x10 <4> [235.651807] ret_from_fork+0x3d4/0x480 <4> [235.651809] ? __pfx_kthread+0x10/0x10 <4> [235.651812] ret_from_fork_asm+0x1a/0x30 <4> [235.651819] </TASK> <4> [235.651820] irq event stamp: 213457 <4> [235.651822] hardirqs last enabled at (213463): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.651824] hardirqs last disabled at (213468): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.651827] softirqs last enabled at (212458): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.651829] softirqs last disabled at (212451): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.651831] ---[ end trace 0000000000000000 ]--- <6> [235.651833] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.651905] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.651911] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.651926] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.652027] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.652316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.652527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.652620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.652767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.652869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.652962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.653051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.653141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.653230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.653318] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.653417] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.653536] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.654552] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.664660] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.664911] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.665952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.666035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.666112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.666191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.666268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.666346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.666425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.666501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.666576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.666657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.666732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.666807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.666884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.666959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.667033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.667107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.667182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.667255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.667329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.667411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.667492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.667574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.667661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.667740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.667817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.667894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.667970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.668049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.668132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.668214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.668296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.668376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.668461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.668546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.668631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.668722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.668802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.668880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.668957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.669033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.669112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.669191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.669272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.669352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.669435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.669513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.669590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.669669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.669747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.669823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.669898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.669977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.670054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.670131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.670210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.670290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.670368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.670445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.670525] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.670637] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.670641] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47250, lrc_seqno=47250, guc_id=0, flags=0x73 in no process [-1] <7> [235.670644] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.671579] ------------[ cut here ]------------ <4> [235.671580] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.671582] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.671663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.671745] autofs4 [last unloaded: snd_hda_intel] <4> [235.671749] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.671752] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.671754] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.671755] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.671760] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.671830] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.671831] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.671834] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.671835] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.671836] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.671837] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.671839] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.671840] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.671842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.671843] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.671845] PKRU: 55555554 <4> [235.671846] Call Trace: <4> [235.671847] <TASK> <4> [235.671851] ? lock_sync+0x100/0x100 <4> [235.671855] ? lock_release+0xd0/0x2b0 <4> [235.671860] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.671867] process_one_work+0x239/0x760 <4> [235.671873] worker_thread+0x200/0x3f0 <4> [235.671876] ? __pfx_worker_thread+0x10/0x10 <4> [235.671878] kthread+0x10d/0x150 <4> [235.671881] ? __pfx_kthread+0x10/0x10 <4> [235.671884] ret_from_fork+0x3d4/0x480 <4> [235.671886] ? __pfx_kthread+0x10/0x10 <4> [235.671890] ret_from_fork_asm+0x1a/0x30 <4> [235.671897] </TASK> <4> [235.671898] irq event stamp: 676449 <4> [235.671899] hardirqs last enabled at (676455): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.671902] hardirqs last disabled at (676460): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.671905] softirqs last enabled at (675706): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.671907] softirqs last disabled at (675685): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.671909] ---[ end trace 0000000000000000 ]--- <7> [235.672293] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.672398] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.672496] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47305, lrc_seqno=47305, guc_id=0, flags=0x73 in no process [-1] <7> [235.672498] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.672558] ------------[ cut here ]------------ <4> [235.672559] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.672561] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.672635] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.672719] autofs4 [last unloaded: snd_hda_intel] <4> [235.672723] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.672725] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.672727] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.672728] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.672733] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.672803] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.672804] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.672807] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.672808] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.672809] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.672810] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.672811] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.672813] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.672814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.672816] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.672817] PKRU: 55555554 <4> [235.672818] Call Trace: <4> [235.672819] <TASK> <4> [235.672823] ? lock_sync+0x100/0x100 <4> [235.672827] ? lock_release+0xd0/0x2b0 <4> [235.672832] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.672838] process_one_work+0x239/0x760 <4> [235.672844] worker_thread+0x200/0x3f0 <4> [235.672846] ? __pfx_worker_thread+0x10/0x10 <4> [235.672849] kthread+0x10d/0x150 <4> [235.672854] ? __pfx_kthread+0x10/0x10 <4> [235.672858] ret_from_fork+0x3d4/0x480 <4> [235.672860] ? __pfx_kthread+0x10/0x10 <4> [235.672863] ret_from_fork_asm+0x1a/0x30 <4> [235.672871] </TASK> <4> [235.672872] irq event stamp: 678353 <4> [235.672873] hardirqs last enabled at (678359): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.672875] hardirqs last disabled at (678364): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.672878] softirqs last enabled at (677702): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.672880] softirqs last disabled at (677695): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.672882] ---[ end trace 0000000000000000 ]--- <6> [235.672884] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.672954] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.672960] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.673161] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.673365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.673455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.673552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.673643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.673744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.673830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.673918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.674006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.674089] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.674185] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.674305] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.675338] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.685655] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.685908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.686936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.687016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.687093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.687172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.687250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.687326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.687402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.687476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.687551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.687626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.687709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.687782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.687856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.687930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.688004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.688078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.688152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.688227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.688302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.688386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.688469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.688548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.688626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.688720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.688797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.688875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.688952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.689032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.689112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.689190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.689273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.689356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.689443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.689528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.689613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.689702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.689785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.689867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.689948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.690025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.690105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.690183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.690261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.690337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.690420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.690501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.690581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.690661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.690740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.690817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.690892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.690970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.691048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.691125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.691201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.691284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.691364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.691442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.691521] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.691634] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.691637] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47305, lrc_seqno=47305, guc_id=0, flags=0x73 in no process [-1] <7> [235.691640] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.691719] ------------[ cut here ]------------ <4> [235.691720] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.691722] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.691795] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.691859] autofs4 [last unloaded: snd_hda_intel] <4> [235.691863] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.691866] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.691867] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.691868] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.691873] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.691942] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.691944] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.691946] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.691948] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.691949] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.691950] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.691951] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.691953] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.691954] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.691956] CR2: 0000749c879ce000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [235.691957] PKRU: 55555554 <4> [235.691959] Call Trace: <4> [235.691960] <TASK> <4> [235.691964] ? lock_sync+0x100/0x100 <4> [235.691968] ? lock_release+0xd0/0x2b0 <4> [235.691973] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.691979] process_one_work+0x239/0x760 <4> [235.691985] worker_thread+0x200/0x3f0 <4> [235.691987] ? __pfx_worker_thread+0x10/0x10 <4> [235.691990] kthread+0x10d/0x150 <4> [235.691993] ? __pfx_kthread+0x10/0x10 <4> [235.691996] ret_from_fork+0x3d4/0x480 <4> [235.691998] ? __pfx_kthread+0x10/0x10 <4> [235.692002] ret_from_fork_asm+0x1a/0x30 <4> [235.692009] </TASK> <4> [235.692010] irq event stamp: 216927 <4> [235.692011] hardirqs last enabled at (216933): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.692014] hardirqs last disabled at (216938): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.692016] softirqs last enabled at (215924): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.692019] softirqs last disabled at (215917): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.692021] ---[ end trace 0000000000000000 ]--- <6> [235.692022] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.692092] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.692098] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.693329] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.693436] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.693542] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.693753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.693846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.693941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.694032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.694123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.694212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.694300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.694389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.694472] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.694568] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.694694] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.695704] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.706426] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.706681] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.707705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.707782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.707857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.707934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.708012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.708090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.708167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.708244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.708320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.708395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.708470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.708545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.708621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.708705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.708779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.708853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.708927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.709001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.709075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.709157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.709237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.709315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.709397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.709478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.709556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.709633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.709720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.709799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.709878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.709959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.710042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.710123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.710209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.710298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.710387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.710471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.710552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.710631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.710722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.710799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.710878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.710959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.711040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.711119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.711201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.711279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.711358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.711440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.711521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.711599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.711683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.711764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.711842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.711919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.711995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.712072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.712148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.712224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.712304] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.712416] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.712420] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47305, lrc_seqno=47305, guc_id=0, flags=0x73 in no process [-1] <7> [235.712423] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.712482] ------------[ cut here ]------------ <4> [235.712483] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.712485] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:3/191 <4> [235.712558] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.712627] autofs4 [last unloaded: snd_hda_intel] <4> [235.712632] CPU: 6 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.712635] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.712636] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.712638] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.712643] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.712728] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.712730] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.712733] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.712735] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.712736] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.712737] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.712739] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.712740] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.712742] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.712744] CR2: 0000749c879cf000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [235.712745] PKRU: 55555554 <4> [235.712747] Call Trace: <4> [235.712748] <TASK> <4> [235.712752] ? lock_sync+0x100/0x100 <4> [235.712756] ? lock_release+0xd0/0x2b0 <4> [235.712762] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.712768] process_one_work+0x239/0x760 <4> [235.712774] worker_thread+0x200/0x3f0 <4> [235.712777] ? __pfx_worker_thread+0x10/0x10 <4> [235.712779] kthread+0x10d/0x150 <4> [235.712782] ? __pfx_kthread+0x10/0x10 <4> [235.712786] ret_from_fork+0x3d4/0x480 <4> [235.712788] ? __pfx_kthread+0x10/0x10 <4> [235.712792] ret_from_fork_asm+0x1a/0x30 <4> [235.712799] </TASK> <4> [235.712800] irq event stamp: 1444847 <4> [235.712802] hardirqs last enabled at (1444853): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.712805] hardirqs last disabled at (1444858): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.712807] softirqs last enabled at (1443868): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.712809] softirqs last disabled at (1443859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.712812] ---[ end trace 0000000000000000 ]--- <7> [235.713828] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.713935] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [235.714024] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47360, lrc_seqno=47360, guc_id=0, flags=0x73 in no process [-1] <7> [235.714028] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.714093] ------------[ cut here ]------------ <4> [235.714094] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.714096] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.714171] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.714238] autofs4 [last unloaded: snd_hda_intel] <4> [235.714242] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.714245] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.714246] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.714247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.714253] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.714325] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.714326] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.714329] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.714330] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.714332] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.714333] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.714334] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.714335] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.714337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.714338] CR2: 0000749c879ca000 CR3: 000000011f50b002 CR4: 0000000000f72ef0 <4> [235.714340] PKRU: 55555554 <4> [235.714341] Call Trace: <4> [235.714342] <TASK> <4> [235.714346] ? lock_sync+0x100/0x100 <4> [235.714351] ? lock_release+0xd0/0x2b0 <4> [235.714356] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.714362] process_one_work+0x239/0x760 <4> [235.714368] worker_thread+0x200/0x3f0 <4> [235.714371] ? __pfx_worker_thread+0x10/0x10 <4> [235.714373] kthread+0x10d/0x150 <4> [235.714376] ? __pfx_kthread+0x10/0x10 <4> [235.714380] ret_from_fork+0x3d4/0x480 <4> [235.714382] ? __pfx_kthread+0x10/0x10 <4> [235.714385] ret_from_fork_asm+0x1a/0x30 <4> [235.714392] </TASK> <4> [235.714394] irq event stamp: 1446731 <4> [235.714395] hardirqs last enabled at (1446737): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.714398] hardirqs last disabled at (1446742): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.714400] softirqs last enabled at (1443868): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.714402] softirqs last disabled at (1443859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.714405] ---[ end trace 0000000000000000 ]--- <6> [235.714407] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.714478] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.714484] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.714653] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.714855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.714946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.715039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.715128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.715216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.715303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.715392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.715485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.715569] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.715686] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.715805] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.716815] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.727538] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.727788] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.728816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.728898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.728977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.729055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.729133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.729209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.729283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.729358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.729433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.729510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.729588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.729672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.729749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.729823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.729897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.729970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.730043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.730118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.730191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.730273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.730355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.730435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.730515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.730593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.730676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.730755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.730833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.730914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.730998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.731079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.731160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.731241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.731325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.731412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.731500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.731583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.731666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.731745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.731823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.731899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.731977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.732055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.732136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.732214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.732296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.732374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.732452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.732528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.732605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.732689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.732764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.732843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.732919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.732996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.733072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.733151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.733227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.733303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.733381] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.733494] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.733498] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47360, lrc_seqno=47360, guc_id=0, flags=0x73 in no process [-1] <7> [235.733500] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.733559] ------------[ cut here ]------------ <4> [235.733560] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.733561] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:3/191 <4> [235.733633] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.733701] autofs4 [last unloaded: snd_hda_intel] <4> [235.733705] CPU: 4 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.733708] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.733709] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.733710] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.733715] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.733785] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.733786] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.733788] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.733790] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.733791] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.733792] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.733794] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.733795] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [235.733797] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.733798] CR2: 0000749c879ca000 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [235.733799] PKRU: 55555554 <4> [235.733801] Call Trace: <4> [235.733802] <TASK> <4> [235.733806] ? lock_sync+0x100/0x100 <4> [235.733810] ? lock_release+0xd0/0x2b0 <4> [235.733815] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.733821] process_one_work+0x239/0x760 <4> [235.733827] worker_thread+0x200/0x3f0 <4> [235.733829] ? __pfx_worker_thread+0x10/0x10 <4> [235.733832] kthread+0x10d/0x150 <4> [235.733835] ? __pfx_kthread+0x10/0x10 <4> [235.733838] ret_from_fork+0x3d4/0x480 <4> [235.733840] ? __pfx_kthread+0x10/0x10 <4> [235.733844] ret_from_fork_asm+0x1a/0x30 <4> [235.733851] </TASK> <4> [235.733852] irq event stamp: 1449911 <4> [235.733853] hardirqs last enabled at (1449917): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.733856] hardirqs last disabled at (1449922): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.733858] softirqs last enabled at (1448722): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.733861] softirqs last disabled at (1448713): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.733863] ---[ end trace 0000000000000000 ]--- <6> [235.733865] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.733933] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.733939] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.735177] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.735281] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.735386] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.735600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.735704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.735800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.735890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.735979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.736068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.736157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.736245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.736329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.736425] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.736542] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.737552] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.747656] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.747906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.748933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.749013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.749091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.749167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.749244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.749320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.749396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.749471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.749549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.749625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.749714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.749789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.749863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.749938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.750012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.750087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.750160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.750235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.750309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.750392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.750475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.750556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.750636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.750725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.750802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.750879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.750957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.751035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.751115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.751193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.751272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.751352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.751441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.751529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.751615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.751706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.751787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.751865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.751943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.752019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.752101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.752183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.752262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.752340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.752422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.752498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.752575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.752654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.752732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.752807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.752883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.752961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.753037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.753114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.753189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.753265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.753340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.753420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.753502] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.753614] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.753618] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47360, lrc_seqno=47360, guc_id=0, flags=0x73 in no process [-1] <7> [235.753620] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.753691] ------------[ cut here ]------------ <4> [235.753692] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.753694] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.753767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.753832] autofs4 [last unloaded: snd_hda_intel] <4> [235.753836] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.753839] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.753840] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.753841] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.753847] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.753916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.753918] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.753920] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.753922] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.753923] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.753924] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.753925] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.753927] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.753928] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.753930] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.753931] PKRU: 55555554 <4> [235.753932] Call Trace: <4> [235.753933] <TASK> <4> [235.753937] ? lock_sync+0x100/0x100 <4> [235.753942] ? lock_release+0xd0/0x2b0 <4> [235.753947] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.753953] process_one_work+0x239/0x760 <4> [235.753959] worker_thread+0x200/0x3f0 <4> [235.753962] ? __pfx_worker_thread+0x10/0x10 <4> [235.753964] kthread+0x10d/0x150 <4> [235.753967] ? __pfx_kthread+0x10/0x10 <4> [235.753971] ret_from_fork+0x3d4/0x480 <4> [235.753973] ? __pfx_kthread+0x10/0x10 <4> [235.753976] ret_from_fork_asm+0x1a/0x30 <4> [235.753983] </TASK> <4> [235.753985] irq event stamp: 683545 <4> [235.753986] hardirqs last enabled at (683551): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.753988] hardirqs last disabled at (683556): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.753991] softirqs last enabled at (682448): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.753993] softirqs last disabled at (682441): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.753995] ---[ end trace 0000000000000000 ]--- <5> [235.755163] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47415, lrc_seqno=47415, guc_id=0, flags=0x73 in no process [-1] <7> [235.755166] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.755228] ------------[ cut here ]------------ <4> [235.755229] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.755230] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.755299] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.755363] autofs4 [last unloaded: snd_hda_intel] <4> [235.755367] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.755369] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.755371] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.755372] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.755377] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.755446] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.755447] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.755449] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.755451] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.755452] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.755453] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.755454] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.755456] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.755457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.755458] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.755460] PKRU: 55555554 <4> [235.755461] Call Trace: <4> [235.755462] <TASK> <4> [235.755466] ? lock_sync+0x100/0x100 <4> [235.755470] ? lock_release+0xd0/0x2b0 <4> [235.755475] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.755481] process_one_work+0x239/0x760 <4> [235.755487] worker_thread+0x200/0x3f0 <4> [235.755489] ? __pfx_worker_thread+0x10/0x10 <4> [235.755492] kthread+0x10d/0x150 <4> [235.755494] ? __pfx_kthread+0x10/0x10 <4> [235.755498] ret_from_fork+0x3d4/0x480 <4> [235.755500] ? __pfx_kthread+0x10/0x10 <4> [235.755503] ret_from_fork_asm+0x1a/0x30 <4> [235.755510] </TASK> <4> [235.755512] irq event stamp: 685427 <4> [235.755513] hardirqs last enabled at (685433): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.755515] hardirqs last disabled at (685438): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.755517] softirqs last enabled at (682448): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.755520] softirqs last disabled at (682441): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.755522] ---[ end trace 0000000000000000 ]--- <6> [235.755524] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.755592] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.755597] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.755837] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.755942] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.756048] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.756250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.756339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.756432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.756523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.756613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.756713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.756800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.756887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.756970] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.757065] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.757184] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.758191] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.768659] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.768908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.769931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.770009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.770085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.770163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.770240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.770317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.770393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.770471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.770549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.770626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.770714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.770790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.770865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.770941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.771015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.771089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.771164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.771238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.771311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.771394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.771476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.771558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.771642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.771737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.771816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.771893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.771970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.772049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.772129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.772207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.772287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.772365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.772448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.772532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.772615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.772705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.772786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.772864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.772942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.773023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.773108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.773190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.773270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.773347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.773428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.773507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.773585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.773664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.773742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.773818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.773894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.773973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.774051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.774128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.774204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.774282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.774358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.774432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.774512] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.774623] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.774627] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47415, lrc_seqno=47415, guc_id=0, flags=0x73 in no process [-1] <7> [235.774629] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.775550] ------------[ cut here ]------------ <4> [235.775551] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.775553] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.775627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.775699] autofs4 [last unloaded: snd_hda_intel] <4> [235.775703] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.775706] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.775707] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.775708] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.775714] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.775784] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.775785] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.775788] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.775789] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.775790] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.775792] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.775793] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.775794] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.775796] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.775797] CR2: 0000749c879cd000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.775799] PKRU: 55555554 <4> [235.775800] Call Trace: <4> [235.775801] <TASK> <4> [235.775805] ? lock_sync+0x100/0x100 <4> [235.775809] ? lock_release+0xd0/0x2b0 <4> [235.775814] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.775820] process_one_work+0x239/0x760 <4> [235.775826] worker_thread+0x200/0x3f0 <4> [235.775829] ? __pfx_worker_thread+0x10/0x10 <4> [235.775831] kthread+0x10d/0x150 <4> [235.775834] ? __pfx_kthread+0x10/0x10 <4> [235.775837] ret_from_fork+0x3d4/0x480 <4> [235.775839] ? __pfx_kthread+0x10/0x10 <4> [235.775843] ret_from_fork_asm+0x1a/0x30 <4> [235.775850] </TASK> <4> [235.775851] irq event stamp: 688561 <4> [235.775852] hardirqs last enabled at (688567): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.775855] hardirqs last disabled at (688572): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.775858] softirqs last enabled at (687970): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.775860] softirqs last disabled at (687963): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.775862] ---[ end trace 0000000000000000 ]--- <6> [235.775864] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.775934] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.775941] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.775956] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.776061] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.776348] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.776556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.776648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.776757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.776847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.776936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.777024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.777113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.777204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.777290] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.777388] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.777505] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.778516] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.788659] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.788909] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.789933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.790012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.790090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.790171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.790249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.790325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.790401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.790475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.790549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.790624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.790709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.790784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.790858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.790932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.791006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.791080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.791154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.791229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.791308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.791393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.791477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.791557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.791639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.791732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.791810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.791890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.791970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.792053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.792135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.792214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.792295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.792373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.792457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.792540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.792624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.792712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.792792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.792868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.792945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.793024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.793107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.793188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.793267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.793344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.793425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.793506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.793588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.793669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.793749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.793825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.793902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.793982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.794058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.794135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.794211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.794290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.794370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.794449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.794530] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.794641] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.794645] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47415, lrc_seqno=47415, guc_id=0, flags=0x73 in no process [-1] <7> [235.794648] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.794728] ------------[ cut here ]------------ <4> [235.794730] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.794731] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:3/191 <4> [235.794803] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.794869] autofs4 [last unloaded: snd_hda_intel] <4> [235.794873] CPU: 6 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.794876] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.794877] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.794879] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.794884] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.794953] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.794955] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.794957] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.794959] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.794960] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.794961] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.794962] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.794964] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.794965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.794967] CR2: 0000749c879cf000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.794968] PKRU: 55555554 <4> [235.794969] Call Trace: <4> [235.794970] <TASK> <4> [235.794974] ? lock_sync+0x100/0x100 <4> [235.794979] ? lock_release+0xd0/0x2b0 <4> [235.794984] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.794990] process_one_work+0x239/0x760 <4> [235.794996] worker_thread+0x200/0x3f0 <4> [235.794999] ? __pfx_worker_thread+0x10/0x10 <4> [235.795002] kthread+0x10d/0x150 <4> [235.795005] ? __pfx_kthread+0x10/0x10 <4> [235.795008] ret_from_fork+0x3d4/0x480 <4> [235.795010] ? __pfx_kthread+0x10/0x10 <4> [235.795014] ret_from_fork_asm+0x1a/0x30 <4> [235.795021] </TASK> <4> [235.795022] irq event stamp: 1453515 <4> [235.795024] hardirqs last enabled at (1453521): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.795027] hardirqs last disabled at (1453526): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.795029] softirqs last enabled at (1452512): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.795032] softirqs last disabled at (1452505): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.795034] ---[ end trace 0000000000000000 ]--- <5> [235.796216] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47470, lrc_seqno=47470, guc_id=0, flags=0x73 in no process [-1] <7> [235.796219] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.796280] ------------[ cut here ]------------ <4> [235.796281] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.796282] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:3/191 <4> [235.796354] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.796418] autofs4 [last unloaded: snd_hda_intel] <4> [235.796421] CPU: 6 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.796424] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.796425] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.796426] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.796431] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.796500] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.796502] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.796504] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.796505] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.796506] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.796508] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.796509] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.796510] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.796512] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.796513] CR2: 0000749c879cf000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.796514] PKRU: 55555554 <4> [235.796515] Call Trace: <4> [235.796517] <TASK> <4> [235.796520] ? lock_sync+0x100/0x100 <4> [235.796524] ? lock_release+0xd0/0x2b0 <4> [235.796530] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.796535] process_one_work+0x239/0x760 <4> [235.796541] worker_thread+0x200/0x3f0 <4> [235.796544] ? __pfx_worker_thread+0x10/0x10 <4> [235.796546] kthread+0x10d/0x150 <4> [235.796549] ? __pfx_kthread+0x10/0x10 <4> [235.796553] ret_from_fork+0x3d4/0x480 <4> [235.796555] ? __pfx_kthread+0x10/0x10 <4> [235.796558] ret_from_fork_asm+0x1a/0x30 <4> [235.796565] </TASK> <4> [235.796566] irq event stamp: 1455367 <4> [235.796567] hardirqs last enabled at (1455373): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.796570] hardirqs last disabled at (1455378): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.796572] softirqs last enabled at (1452512): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.796575] softirqs last disabled at (1452505): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.796577] ---[ end trace 0000000000000000 ]--- <6> [235.796578] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.796647] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.796662] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.796816] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.796919] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.797036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.797239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.797328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.797422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.797513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.797601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.797695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.797781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.797867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.797949] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.798045] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.798161] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.799167] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.809657] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.809909] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.810942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.811021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.811098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.811175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.811251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.811326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.811400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.811475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.811551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.811626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.811714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.811790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.811866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.811942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.812017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.812091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.812166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.812240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.812314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.812396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.812478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.812561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.812642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.812733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.812810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.812885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.812962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.813040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.813119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.813198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.813282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.813364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.813450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.813534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.813619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.813709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.813789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.813868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.813945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.814025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.814109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.814190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.814268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.814346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.814429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.814507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.814585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.814664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.814742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.814820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.814900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.814982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.815061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.815140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.815218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.815296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.815375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.815454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.815536] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.815649] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.816497] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47470, lrc_seqno=47470, guc_id=0, flags=0x73 in no process [-1] <7> [235.816499] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.816560] ------------[ cut here ]------------ <4> [235.816561] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.816563] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/120 <4> [235.816633] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.816703] autofs4 [last unloaded: snd_hda_intel] <4> [235.816707] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.816710] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.816711] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.816712] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.816718] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.816787] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.816789] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.816791] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.816793] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.816794] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.816795] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.816796] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.816798] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.816800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.816801] CR2: 0000749c879cf000 CR3: 0000000122e3e006 CR4: 0000000000f72ef0 <4> [235.816802] PKRU: 55555554 <4> [235.816804] Call Trace: <4> [235.816805] <TASK> <4> [235.816809] ? lock_sync+0x100/0x100 <4> [235.816813] ? lock_release+0xd0/0x2b0 <4> [235.816818] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.816824] process_one_work+0x239/0x760 <4> [235.816830] worker_thread+0x200/0x3f0 <4> [235.816833] ? __pfx_worker_thread+0x10/0x10 <4> [235.816835] kthread+0x10d/0x150 <4> [235.816838] ? __pfx_kthread+0x10/0x10 <4> [235.816842] ret_from_fork+0x3d4/0x480 <4> [235.816844] ? __pfx_kthread+0x10/0x10 <4> [235.816847] ret_from_fork_asm+0x1a/0x30 <4> [235.816855] </TASK> <4> [235.816856] irq event stamp: 691953 <4> [235.816857] hardirqs last enabled at (691959): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.816860] hardirqs last disabled at (691964): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.816862] softirqs last enabled at (691332): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.816864] softirqs last disabled at (691327): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.816867] ---[ end trace 0000000000000000 ]--- <6> [235.816868] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.816938] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.816944] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.816958] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.817061] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.817353] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.817564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.817660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.817756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.817845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.817933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.818019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.818105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.818192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.818275] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.818372] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.818493] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.819501] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.829662] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.829913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.830950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.831029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.831106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.831185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.831265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.831343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.831418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.831494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.831570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.831645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.831741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.831815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.831889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.831964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.832039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.832112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.832189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.832266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.832342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.832427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.832509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.832589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.832678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.832757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.832834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.832913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.832992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.833073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.833156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.833235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.833315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.833398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.833486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.833572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.833661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.833743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.833824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.833902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.833981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.834062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.834147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.834229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.834308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.834386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.834467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.834545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.834623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.834709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.834794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.834873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.834951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.835032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.835111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.835189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.835265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.835343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.835424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.835505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.835587] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.835716] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.835720] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47470, lrc_seqno=47470, guc_id=0, flags=0x73 in no process [-1] <7> [235.835723] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.835781] ------------[ cut here ]------------ <4> [235.835783] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.835784] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:10/2392 <4> [235.835855] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.835921] autofs4 [last unloaded: snd_hda_intel] <4> [235.835925] CPU: 2 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.835928] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.835929] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.835930] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.835936] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.836005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.836006] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.836009] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.836010] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.836011] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.836013] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.836014] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.836015] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [235.836017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.836018] CR2: 0000749c879ce000 CR3: 000000011f50b004 CR4: 0000000000f72ef0 <4> [235.836020] PKRU: 55555554 <4> [235.836021] Call Trace: <4> [235.836022] <TASK> <4> [235.836026] ? lock_sync+0x100/0x100 <4> [235.836030] ? lock_release+0xd0/0x2b0 <4> [235.836036] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.836042] process_one_work+0x239/0x760 <4> [235.836048] worker_thread+0x200/0x3f0 <4> [235.836051] ? __pfx_worker_thread+0x10/0x10 <4> [235.836053] kthread+0x10d/0x150 <4> [235.836056] ? __pfx_kthread+0x10/0x10 <4> [235.836060] ret_from_fork+0x3d4/0x480 <4> [235.836062] ? __pfx_kthread+0x10/0x10 <4> [235.836065] ret_from_fork_asm+0x1a/0x30 <4> [235.836072] </TASK> <4> [235.836073] irq event stamp: 224093 <4> [235.836075] hardirqs last enabled at (224099): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.836077] hardirqs last disabled at (224104): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.836080] softirqs last enabled at (222990): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.836082] softirqs last disabled at (222981): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.836084] ---[ end trace 0000000000000000 ]--- <5> [235.836992] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47525, lrc_seqno=47525, guc_id=0, flags=0x73 in no process [-1] <7> [235.836999] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.837106] ------------[ cut here ]------------ <4> [235.837108] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.837110] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/2392 <4> [235.837186] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.837262] autofs4 [last unloaded: snd_hda_intel] <4> [235.837267] CPU: 6 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.837270] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.837272] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.837274] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.837282] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.837362] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.837363] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.837366] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.837367] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.837369] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.837370] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.837371] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.837373] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.837374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.837376] CR2: 0000749c879cf000 CR3: 000000011f50b005 CR4: 0000000000f72ef0 <4> [235.837377] PKRU: 55555554 <4> [235.837379] Call Trace: <4> [235.837380] <TASK> <4> [235.837383] ? lock_sync+0x100/0x100 <4> [235.837388] ? lock_release+0xd0/0x2b0 <4> [235.837393] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.837399] process_one_work+0x239/0x760 <4> [235.837405] worker_thread+0x200/0x3f0 <4> [235.837408] ? __pfx_worker_thread+0x10/0x10 <4> [235.837410] kthread+0x10d/0x150 <4> [235.837413] ? __pfx_kthread+0x10/0x10 <4> [235.837417] ret_from_fork+0x3d4/0x480 <4> [235.837419] ? __pfx_kthread+0x10/0x10 <4> [235.837423] ret_from_fork_asm+0x1a/0x30 <4> [235.837430] </TASK> <4> [235.837431] irq event stamp: 226001 <4> [235.837432] hardirqs last enabled at (226007): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.837435] hardirqs last disabled at (226012): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.837437] softirqs last enabled at (222990): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.837440] softirqs last disabled at (222981): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.837442] ---[ end trace 0000000000000000 ]--- <7> [235.837424] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [235.837444] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.837516] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.837522] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.837530] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.837743] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.837948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.838038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.838134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.838222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.838311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.838396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.838483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.838575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.838666] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.838764] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.838883] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.839892] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.849659] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.849910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.850934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.851014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.851092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.851170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.851246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.851321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.851396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.851470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.851544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.851617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.851701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.851774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.851848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.851922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.851995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.852069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.852142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.852216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.852289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.852372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.852454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.852533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.852612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.852699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.852777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.852855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.852933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.853012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.853092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.853170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.853248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.853327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.853411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.853494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.853577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.853667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.853747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.853824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.853902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.853978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.854061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.854144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.854226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.854304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.854386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.854465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.854542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.854619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.854706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.854783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.854858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.854938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.855015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.855094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.855172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.855253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.855332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.855408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.855488] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.855600] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.855604] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47525, lrc_seqno=47525, guc_id=0, flags=0x73 in no process [-1] <7> [235.855606] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.855674] ------------[ cut here ]------------ <4> [235.855675] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.855677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:10/2392 <4> [235.855749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.855813] autofs4 [last unloaded: snd_hda_intel] <4> [235.855817] CPU: 6 UID: 0 PID: 2392 Comm: kworker/u64:10 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.855820] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.855821] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.855822] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.855828] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.855897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.855899] RSP: 0018:ffffc90003d0bca0 EFLAGS: 00010246 <4> [235.855901] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.855902] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.855904] RBP: ffffc90003d0bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.855905] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.855906] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.855908] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.855909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.855911] CR2: 0000749c879cf000 CR3: 000000011f50b005 CR4: 0000000000f72ef0 <4> [235.855912] PKRU: 55555554 <4> [235.855913] Call Trace: <4> [235.855914] <TASK> <4> [235.855918] ? lock_sync+0x100/0x100 <4> [235.855923] ? lock_release+0xd0/0x2b0 <4> [235.855928] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.855934] process_one_work+0x239/0x760 <4> [235.855940] worker_thread+0x200/0x3f0 <4> [235.855943] ? __pfx_worker_thread+0x10/0x10 <4> [235.855946] kthread+0x10d/0x150 <4> [235.855948] ? __pfx_kthread+0x10/0x10 <4> [235.855952] ret_from_fork+0x3d4/0x480 <4> [235.855954] ? __pfx_kthread+0x10/0x10 <4> [235.855958] ret_from_fork_asm+0x1a/0x30 <4> [235.855965] </TASK> <4> [235.855966] irq event stamp: 229257 <4> [235.855967] hardirqs last enabled at (229263): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.855970] hardirqs last disabled at (229268): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.855972] softirqs last enabled at (228348): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.855975] softirqs last disabled at (228341): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.855977] ---[ end trace 0000000000000000 ]--- <6> [235.855979] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.856050] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.856055] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.857315] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.857419] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.857523] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.857735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.857828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.857926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.858015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.858103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.858189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.858274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.858361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.858443] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.858540] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.858661] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.859673] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.869659] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.869935] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.870990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.871071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.871149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.871227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.871303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.871380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.871456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.871532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.871607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.871703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.871778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.871857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.871935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.872013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.872089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.872163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.872237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.872312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.872387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.872469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.872550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.872630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.872721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.872804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.872882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.872961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.873040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.873120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.873199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.873277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.873357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.873437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.873524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.873612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.873707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.873789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.873870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.873949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.874027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.874105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.874184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.874262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.874341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.874421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.874503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.874582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.874664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.874741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.874821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.874898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.874974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.875053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.875130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.875207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.875284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.875362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.875438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.875514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.875593] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.875707] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.875712] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47525, lrc_seqno=47525, guc_id=0, flags=0x73 in no process [-1] <7> [235.875714] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.875773] ------------[ cut here ]------------ <4> [235.875774] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.875775] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.875848] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.875914] autofs4 [last unloaded: snd_hda_intel] <4> [235.875918] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.875921] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.875922] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.875923] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.875929] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.875998] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.875999] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.876002] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.876003] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.876004] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.876005] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.876007] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.876008] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.876010] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.876011] CR2: 0000749c879d3000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.876012] PKRU: 55555554 <4> [235.876014] Call Trace: <4> [235.876015] <TASK> <4> [235.876019] ? lock_sync+0x100/0x100 <4> [235.876023] ? lock_release+0xd0/0x2b0 <4> [235.876029] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.876034] process_one_work+0x239/0x760 <4> [235.876041] worker_thread+0x200/0x3f0 <4> [235.876043] ? __pfx_worker_thread+0x10/0x10 <4> [235.876046] kthread+0x10d/0x150 <4> [235.876049] ? __pfx_kthread+0x10/0x10 <4> [235.876052] ret_from_fork+0x3d4/0x480 <4> [235.876054] ? __pfx_kthread+0x10/0x10 <4> [235.876058] ret_from_fork_asm+0x1a/0x30 <4> [235.876065] </TASK> <4> [235.876066] irq event stamp: 695363 <4> [235.876067] hardirqs last enabled at (695369): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.876070] hardirqs last disabled at (695374): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.876073] softirqs last enabled at (694528): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.876075] softirqs last disabled at (694521): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.876077] ---[ end trace 0000000000000000 ]--- <5> [235.877293] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47580, lrc_seqno=47580, guc_id=0, flags=0x73 in no process [-1] <7> [235.877296] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.877363] ------------[ cut here ]------------ <4> [235.877364] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.877366] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/120 <4> [235.877434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.877499] autofs4 [last unloaded: snd_hda_intel] <4> [235.877502] CPU: 10 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.877505] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.877506] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.877507] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.877512] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.877580] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.877582] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246 <4> [235.877584] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.877585] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.877586] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.877588] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.877589] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.877590] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [235.877591] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.877593] CR2: 0000749c879d3000 CR3: 0000000122e3e004 CR4: 0000000000f72ef0 <4> [235.877594] PKRU: 55555554 <4> [235.877595] Call Trace: <4> [235.877596] <TASK> <4> [235.877600] ? lock_sync+0x100/0x100 <4> [235.877604] ? lock_release+0xd0/0x2b0 <4> [235.877609] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.877615] process_one_work+0x239/0x760 <4> [235.877621] worker_thread+0x200/0x3f0 <4> [235.877624] ? __pfx_worker_thread+0x10/0x10 <4> [235.877626] kthread+0x10d/0x150 <4> [235.877629] ? __pfx_kthread+0x10/0x10 <4> [235.877633] ret_from_fork+0x3d4/0x480 <4> [235.877634] ? __pfx_kthread+0x10/0x10 <4> [235.877638] ret_from_fork_asm+0x1a/0x30 <4> [235.877645] </TASK> <4> [235.877646] irq event stamp: 697233 <4> [235.877648] hardirqs last enabled at (697239): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.877654] hardirqs last disabled at (697246): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.877656] softirqs last enabled at (694528): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.877659] softirqs last disabled at (694521): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.877661] ---[ end trace 0000000000000000 ]--- <6> [235.877663] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.877734] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [235.877740] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [235.877901] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [235.878006] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [235.878110] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [235.878315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [235.878412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [235.878506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [235.878594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [235.878684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [235.878771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [235.878857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [235.878943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [235.879026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [235.879124] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [235.879240] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [235.880246] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [235.890658] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [235.890910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [235.891877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [235.891957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [235.892035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [235.892113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [235.892193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [235.892271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [235.892348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [235.892423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [235.892498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [235.892573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [235.892647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [235.892736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [235.892810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [235.892884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [235.892960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [235.893037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [235.893112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [235.893187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [235.893260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [235.893342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [235.893423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [235.893502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [235.893584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [235.893678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [235.893759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [235.893838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [235.893916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [235.893995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [235.894075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [235.894154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [235.894235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [235.894314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [235.894399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [235.894484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [235.894568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [235.894649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [235.894742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [235.894820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [235.894897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [235.894974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [235.895054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [235.895133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [235.895216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [235.895299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [235.895382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [235.895461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [235.895540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [235.895619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [235.895709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [235.895788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [235.895867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [235.895948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [235.896026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [235.896104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [235.896182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [235.896265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [235.896345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [235.896424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [235.896504] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [235.896618] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [235.896622] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47580, lrc_seqno=47580, guc_id=0, flags=0x73 in no process [-1] <7> [235.896625] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [235.896698] ------------[ cut here ]------------ <4> [235.896699] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [235.896700] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:3/191 <4> [235.896774] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [235.896839] autofs4 [last unloaded: snd_hda_intel] <4> [235.896843] CPU: 6 UID: 0 PID: 191 Comm: kworker/u64:3 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-165141v1-debug+ #1 PREEMPT(lazy) <4> [235.896846] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [235.896847] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [235.896848] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [235.896853] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [235.896923] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [235.896925] RSP: 0018:ffffc900015b7ca0 EFLAGS: 00010246 <4> [235.896927] RAX: ffffffffa12046c3 RBX: 0000000000000000 RCX: 0000000000000000 <4> [235.896928] RDX: ffff888103e7d010 RSI: ffffffffa12046c3 RDI: ffffffffa1003ef0 <4> [235.896929] RBP: ffffc900015b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [235.896931] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [235.896932] R13: ffff888103e7d010 R14: ffff888122c12018 R15: 00000000ffffffc2 <4> [235.896933] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [235.896935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [235.896936] CR2: 0000749c879cf000 CR3: 000000011f50b005 CR4: 0000000000f72ef0 <4> [235.896938] PKRU: 55555554 <4> [235.896939] Call Trace: <4> [235.896940] <TASK> <4> [235.896944] ? lock_sync+0x100/0x100 <4> [235.896948] ? lock_release+0xd0/0x2b0 <4> [235.896953] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [235.896959] process_one_work+0x239/0x760 <4> [235.896965] worker_thread+0x200/0x3f0 <4> [235.896968] ? __pfx_worker_thread+0x10/0x10 <4> [235.896970] kthread+0x10d/0x150 <4> [235.896973] ? __pfx_kthread+0x10/0x10 <4> [235.896977] ret_from_fork+0x3d4/0x480 <4> [235.896979] ? __pfx_kthread+0x10/0x10 <4> [235.896982] ret_from_fork_asm+0x1a/0x30 <4> [235.896989] </TASK> <4> [235.896990] irq event stamp: 1462351 <4> [235.896992] hardirqs last enabled at (1462357): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [235.896994] hardirqs last disabled at (1462362): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [235.896997] softirqs last enabled at (1461356): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.896999] softirqs last disabled at (1461349): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [235.897001] ---[ end trace 0000000000000000 ]--- <6> [235.897003] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [235.897072] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued

<4> [234.473255] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.473408] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.494680] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.494838] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.513770] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.513924] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.515045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.515336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.534898] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.535048] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.554537] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.554702] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.556203] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.556349] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.575916] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.576068] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.596213] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.596370] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.597810] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.597961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.618063] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.618214] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.639009] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.639162] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.640608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.640792] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.660920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.661157] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.680849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.680999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.682307] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.682509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.702338] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.702485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.723122] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.723271] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.724678] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.724825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.743860] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.744012] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.763724] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.763873] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.765284] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.765430] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.784828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.784976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.805643] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.805794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.807230] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.807378] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.827148] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.827300] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.847867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.848022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.848690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.848874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.868611] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.868767] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.887723] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.887874] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.889425] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.889571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.908909] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.909060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.928662] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.928812] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.930515] xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [234.930712] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.949803] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.949955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.969494] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.969643] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.971354] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.971502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.990796] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [234.990946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.011756] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.011907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.013226] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.013439] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.032875] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.033024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.052800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.052951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.054390] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.054537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.074052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.074206] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.095247] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.095398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.096872] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.097031] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.116627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.116782] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.135826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.135975] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.137419] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.137563] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.156870] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.157018] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.176701] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.176872] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.178307] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64

<4> [235.178358] mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [235.178457] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.198723] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.198878] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.217755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.217905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.219347] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.219493] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.239627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.239805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.259094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.259244] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.260681] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.260888] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.279783] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.279932] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.299966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.300118] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.301560] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.301730] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.320883] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.321033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.341694] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.341845] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.343298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.343460] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.363284] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.363434] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.383718] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.383869] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.384974] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.385143] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.403791] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.403941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.423530] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.423691] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.425274] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.425426] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.445541] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.445699] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.465795] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.465945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.467313] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake

<4> [235.467466] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.487648] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.487817] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.506776] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.506924] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.508348] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.508495] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.527837] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.527987] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.547816] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.547966] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.549420] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.549567] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.568797] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.568946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.588812] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.588961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.590390] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.590538] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.609811] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.609961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.629494] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.629642] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.631376] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.631524] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.651600] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.651753] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.671663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.671830] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.672635] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.672803] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.691795] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.691942] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.712558] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.712728] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.714171] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.714325] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.733633] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.733785] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.753767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.753916] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.755299] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.755446] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.775627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.775784] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.794803] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.794953] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.796354] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.796500] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.816633] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.816787] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.835855] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.836005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.837186] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.837362] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.855749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.855897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.875848] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.875998] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.877434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.877580] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [235.896774] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp binfmt_misc hid_generic cmdlinepart spi_nor asus_nb_wmi mei_pxp mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel kvm irqbypass usbhid ghash_clmulni_intel aesni_intel hid snd_intel_dspcfg rapl snd_hda_codec snd_hda_core intel_cstate r8169 video snd_hwdep nls_iso8859_1 realtek snd_pcm snd_timer i2c_i801 snd i2c_mux intel_pmc_core spi_intel_pci idma64 mei_me i2c_smbus spi_intel soundcore mei pmt_telemetry pmt_discovery wmi pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_tad acpi_pad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [235.896923] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 66 de 5e e1 48 89 c6 48 8d 3d 6c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching