igt@kms_async_flips@async-flip-with-page-flip-events-tiled@pipe-c-hdmi-a-3-4 on shard-bmg@IGTPW

Detail	Value
Duration	2.73 seconds
Hostname	shard-bmg-8
Igt-Version	IGT-Version: 2.3-g0918a5c2c (x86_64) (Linux: 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ x86_64)
Out	Starting dynamic subtest: pipe-C-HDMI-A-3-4 Dynamic subtest pipe-C-HDMI-A-3-4: SUCCESS (2.728s)
Err	Starting dynamic subtest: pipe-C-HDMI-A-3-4 Dynamic subtest pipe-C-HDMI-A-3-4: SUCCESS (2.728s)
Dmesg Scroll to first warning	<6> [342.147717] [IGT] kms_async_flips: starting dynamic subtest pipe-C-HDMI-A-3-4 <7> [342.148442] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:560] from all active usage due to RMFB ioctl <7> [342.148487] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:270:plane 1C] because [FB:560] is removed <7> [342.148524] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 123) -> ( 0 - 0), size 123 -> 0 <7> [342.148671] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [342.148787] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [342.148892] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [342.148995] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [342.149116] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:386:pipe C] data rate 0 num active planes 0 <7> [342.149259] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000 <7> [342.149444] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000 <7> [342.149584] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0 <5> [342.159048] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16785, lrc_seqno=16785, guc_id=0, flags=0x73 in no process [-1] <7> [342.159061] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.159224] ------------[ cut here ]------------ <4> [342.159227] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.159231] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.159440] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass <7> [342.159529] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:557] <4> [342.159536] snd_hda_core <4> [342.159539] snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.159613] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.159620] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.159623] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.159627] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.159639] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.159809] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.159813] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.159818] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.159821] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.159824] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.159827] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.159829] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.159832] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.159836] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.159839] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.159842] PKRU: 55555554 <4> [342.159845] Call Trace: <4> [342.159847] <TASK> <4> [342.159857] ? __pfx_lock_acquire+0x10/0x10 <4> [342.159871] ? lock_release+0xd0/0x2b0 <4> [342.159883] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.159896] process_one_work+0x22e/0x740 <4> [342.159913] worker_thread+0x1e8/0x3d0 <4> [342.159921] ? __pfx_worker_thread+0x10/0x10 <4> [342.159928] kthread+0x10d/0x150 <4> [342.159934] ? __pfx_kthread+0x10/0x10 <4> [342.159942] ret_from_fork+0x3d4/0x480 <4> [342.159949] ? __pfx_kthread+0x10/0x10 <4> [342.159956] ret_from_fork_asm+0x1a/0x30 <4> [342.159973] </TASK> <4> [342.159975] irq event stamp: 910677 <4> [342.159978] hardirqs last enabled at (910683): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.159984] hardirqs last disabled at (910688): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.159989] softirqs last enabled at (909904): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.159994] softirqs last disabled at (909889): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.159998] ---[ end trace 0000000000000000 ]--- <6> [342.160003] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.160169] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.160187] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.160290] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.160685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.160911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.161131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.161359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.161580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.161785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.161994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.162207] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.162479] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.162759] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.164006] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.174306] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.174614] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.176030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.176124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.176214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.176308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.176395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.176479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.176561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.176643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.176720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.176796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.176871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.176946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.177019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.177092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.177164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.177238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.177315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.177386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.177456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.177534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.177610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.177684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.177758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.177831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.177903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.177973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.178043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.178115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.178188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.178259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.178339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.178410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.178493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.178571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.178648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.178721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.178793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.178861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.178931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.178999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.179067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.179134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.179202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.179269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.179351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.179419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.179488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.179557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.179624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.179690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.179758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.179829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.179899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.179968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.180036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.180106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.180173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.180241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.180315] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.180448] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.180452] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16785, lrc_seqno=16785, guc_id=0, flags=0x73 in no process [-1] <7> [342.180455] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.180512] ------------[ cut here ]------------ <4> [342.180513] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.180514] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.180585] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.180647] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.180655] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.180658] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.180659] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.180660] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.180666] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.180733] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.180735] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.180737] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.180738] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.180740] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.180741] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.180742] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.180743] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.180744] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.180746] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.180747] PKRU: 55555554 <4> [342.180748] Call Trace: <4> [342.180749] <TASK> <4> [342.180753] ? __pfx_lock_acquire+0x10/0x10 <4> [342.180759] ? lock_release+0xd0/0x2b0 <4> [342.180764] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.180769] process_one_work+0x22e/0x740 <4> [342.180777] worker_thread+0x1e8/0x3d0 <4> [342.180780] ? __pfx_worker_thread+0x10/0x10 <4> [342.180783] kthread+0x10d/0x150 <4> [342.180786] ? __pfx_kthread+0x10/0x10 <4> [342.180789] ret_from_fork+0x3d4/0x480 <4> [342.180792] ? __pfx_kthread+0x10/0x10 <4> [342.180795] ret_from_fork_asm+0x1a/0x30 <4> [342.180802] </TASK> <4> [342.180803] irq event stamp: 913763 <4> [342.180804] hardirqs last enabled at (913769): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.180807] hardirqs last disabled at (913774): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.180809] softirqs last enabled at (912882): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.180811] softirqs last disabled at (912875): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.180813] ---[ end trace 0000000000000000 ]--- <6> [342.180815] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.180882] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.180889] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.181168] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.181373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.181455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.181541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.181622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.181699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.181777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.181855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.181930] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.182023] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.182134] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.183145] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.193865] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.194120] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.195500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.195576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.195650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.195723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.195795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.195866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.195936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.196007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.196077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.196147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.196217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.196286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.196371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.196441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.196510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.196577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.196644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.196712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.196780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.196859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.196935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.197008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.197080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.197151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.197220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.197289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.197372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.197444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.197516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.197585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.197655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.197726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.197802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.197878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.197952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.198025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.198097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.198167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.198236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.198307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.198379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.198450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.198520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.198586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.198659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.198729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.198798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.198868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.198937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.199005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.199072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.199144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.199213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.199283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.199362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.199432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.199500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.199567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.199639] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.199752] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.199756] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16785, lrc_seqno=16785, guc_id=0, flags=0x73 in no process [-1] <7> [342.199758] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.199815] ------------[ cut here ]------------ <4> [342.199816] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.199817] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.199886] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.199943] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.199950] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.199953] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.199954] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.199955] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.199960] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.200028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.200030] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.200032] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.200033] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.200034] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.200035] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.200036] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.200038] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.200039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.200040] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.200042] PKRU: 55555554 <4> [342.200043] Call Trace: <4> [342.200044] <TASK> <4> [342.200047] ? __pfx_lock_acquire+0x10/0x10 <4> [342.200052] ? lock_release+0xd0/0x2b0 <4> [342.200057] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.200063] process_one_work+0x22e/0x740 <4> [342.200069] worker_thread+0x1e8/0x3d0 <4> [342.200072] ? __pfx_worker_thread+0x10/0x10 <4> [342.200075] kthread+0x10d/0x150 <4> [342.200078] ? __pfx_kthread+0x10/0x10 <4> [342.200081] ret_from_fork+0x3d4/0x480 <4> [342.200084] ? __pfx_kthread+0x10/0x10 <4> [342.200087] ret_from_fork_asm+0x1a/0x30 <4> [342.200093] </TASK> <4> [342.200094] irq event stamp: 916897 <4> [342.200095] hardirqs last enabled at (916903): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.200098] hardirqs last disabled at (916908): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.200100] softirqs last enabled at (915888): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.200102] softirqs last disabled at (915881): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.200104] ---[ end trace 0000000000000000 ]--- <7> [342.201307] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.201413] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.207368] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16801, lrc_seqno=16801, guc_id=0, flags=0x73 in no process [-1] <7> [342.207371] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.207434] ------------[ cut here ]------------ <4> [342.207435] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.207436] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.207506] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.207563] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.207570] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.207573] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.207574] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.207575] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.207580] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.207648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.207650] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.207652] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.207653] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.207654] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.207655] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.207656] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.207657] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.207659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.207660] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.207661] PKRU: 55555554 <4> [342.207662] Call Trace: <4> [342.207663] <TASK> <4> [342.207667] ? __pfx_lock_acquire+0x10/0x10 <4> [342.207672] ? lock_release+0xd0/0x2b0 <4> [342.207677] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.207682] process_one_work+0x22e/0x740 <4> [342.207689] worker_thread+0x1e8/0x3d0 <4> [342.207692] ? __pfx_worker_thread+0x10/0x10 <4> [342.207695] kthread+0x10d/0x150 <4> [342.207698] ? __pfx_kthread+0x10/0x10 <4> [342.207701] ret_from_fork+0x3d4/0x480 <4> [342.207704] ? __pfx_kthread+0x10/0x10 <4> [342.207706] ret_from_fork_asm+0x1a/0x30 <4> [342.207713] </TASK> <4> [342.207714] irq event stamp: 918465 <4> [342.207715] hardirqs last enabled at (918471): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.207718] hardirqs last disabled at (918476): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.207720] softirqs last enabled at (917480): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70 <4> [342.207721] softirqs last disabled at (917478): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120 <4> [342.207724] ---[ end trace 0000000000000000 ]--- <6> [342.207725] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.207792] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.207798] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.208078] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.208279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.208375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.208462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.208543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.208622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.208700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.208778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.208850] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.208940] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.209051] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.210066] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.220650] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.220906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.222106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.222182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.222254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.222335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.222406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.222478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.222546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.222614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.222683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.222749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.222816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.222885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.222955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.223023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.223092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.223157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.223225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.223298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.223365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.223442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.223519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.223589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.223662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.223733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.223803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.223873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.223944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.224018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.224091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.224160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.224232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.224307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.224385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.224462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.224538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.224611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.224684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.224753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.224823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.224891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.224964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.225035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.225104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.225172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.225244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.225318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.225388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.225456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.225524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.225591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.225659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.225732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.225804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.225875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.225944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.226014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.226082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.226147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.226219] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.226341] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.226345] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16801, lrc_seqno=16801, guc_id=0, flags=0x73 in no process [-1] <7> [342.226347] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.226403] ------------[ cut here ]------------ <4> [342.226404] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.226406] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.226474] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.226532] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.226539] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.226542] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.226543] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.226544] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.226549] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.226616] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.226618] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.226620] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.226621] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.226623] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.226624] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.226625] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.226626] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.226627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.226629] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.226630] PKRU: 55555554 <4> [342.226631] Call Trace: <4> [342.226632] <TASK> <4> [342.226636] ? __pfx_lock_acquire+0x10/0x10 <4> [342.226641] ? lock_release+0xd0/0x2b0 <4> [342.226646] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.226651] process_one_work+0x22e/0x740 <4> [342.226658] worker_thread+0x1e8/0x3d0 <4> [342.226661] ? __pfx_worker_thread+0x10/0x10 <4> [342.226664] kthread+0x10d/0x150 <4> [342.226667] ? __pfx_kthread+0x10/0x10 <4> [342.226670] ret_from_fork+0x3d4/0x480 <4> [342.226672] ? __pfx_kthread+0x10/0x10 <4> [342.226675] ret_from_fork_asm+0x1a/0x30 <4> [342.226682] </TASK> <4> [342.226683] irq event stamp: 921541 <4> [342.226684] hardirqs last enabled at (921547): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.226687] hardirqs last disabled at (921552): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.226689] softirqs last enabled at (920462): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.226691] softirqs last disabled at (920457): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.226693] ---[ end trace 0000000000000000 ]--- <6> [342.226694] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.226761] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.226768] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.227829] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.227933] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.228037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.228252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.228371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.228468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.228552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.228633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.228713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.228792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.228869] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.228962] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.229073] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.230089] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.240655] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.240911] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.242211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.242290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.242385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.242474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.242546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.242616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.242687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.242757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.242826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.242895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.242964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.243032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.243100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.243167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.243235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.243310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.243404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.243474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.243543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.243622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.243699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.243773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.243848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.243920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.243991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.244063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.244135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.244209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.244285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.244373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.244473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.244548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.244627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.244704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.244781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.244855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.244928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.244998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.245068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.245138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.245210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.245280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.245365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.245452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.245527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.245597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.245667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.245737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.245808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.245879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.245948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.246020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.246091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.246163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.246232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.246308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.246398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.246468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.246541] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.246666] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.246670] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16801, lrc_seqno=16801, guc_id=0, flags=0x73 in no process [-1] <7> [342.246673] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.246731] ------------[ cut here ]------------ <4> [342.246732] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.246733] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:5/204 <4> [342.246803] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.246863] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.246871] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.246873] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.246874] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.246876] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.246881] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.246949] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.246951] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.246953] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.246954] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.246955] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.246957] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.246958] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.246959] FS: 0000000000000000(0000) GS:ffff8888db21b000(0000) knlGS:0000000000000000 <4> [342.246960] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.246962] CR2: 000000c000410000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.246963] PKRU: 55555554 <4> [342.246964] Call Trace: <4> [342.246965] <TASK> <4> [342.246969] ? __pfx_lock_acquire+0x10/0x10 <4> [342.246974] ? lock_release+0xd0/0x2b0 <4> [342.246979] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.246985] process_one_work+0x22e/0x740 <4> [342.246992] worker_thread+0x1e8/0x3d0 <4> [342.246995] ? __pfx_worker_thread+0x10/0x10 <4> [342.246998] kthread+0x10d/0x150 <4> [342.247000] ? __pfx_kthread+0x10/0x10 <4> [342.247004] ret_from_fork+0x3d4/0x480 <4> [342.247006] ? __pfx_kthread+0x10/0x10 <4> [342.247009] ret_from_fork_asm+0x1a/0x30 <4> [342.247016] </TASK> <4> [342.247017] irq event stamp: 1609309 <4> [342.247018] hardirqs last enabled at (1609315): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.247021] hardirqs last disabled at (1609320): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.247022] softirqs last enabled at (1608322): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.247025] softirqs last disabled at (1608317): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.247027] ---[ end trace 0000000000000000 ]--- <7> [342.248214] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.248328] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.249086] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16802, lrc_seqno=16802, guc_id=0, flags=0x73 in no process [-1] <7> [342.249089] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.249149] ------------[ cut here ]------------ <4> [342.249151] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.249152] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:9/208 <4> [342.249223] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.249282] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.249289] CPU: 8 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.249292] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.249298] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.249300] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.249305] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.249376] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.249377] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.249379] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.249380] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.249382] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.249383] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.249384] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.249385] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.249386] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.249388] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.249389] PKRU: 55555554 <4> [342.249390] Call Trace: <4> [342.249391] <TASK> <4> [342.249395] ? __pfx_lock_acquire+0x10/0x10 <4> [342.249400] ? lock_release+0xd0/0x2b0 <4> [342.249405] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.249410] process_one_work+0x22e/0x740 <4> [342.249417] worker_thread+0x1e8/0x3d0 <4> [342.249421] ? __pfx_worker_thread+0x10/0x10 <4> [342.249424] kthread+0x10d/0x150 <4> [342.249426] ? __pfx_kthread+0x10/0x10 <4> [342.249429] ret_from_fork+0x3d4/0x480 <4> [342.249432] ? __pfx_kthread+0x10/0x10 <4> [342.249435] ret_from_fork_asm+0x1a/0x30 <4> [342.249442] </TASK> <4> [342.249443] irq event stamp: 1889651 <4> [342.249444] hardirqs last enabled at (1889657): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.249446] hardirqs last disabled at (1889662): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.249448] softirqs last enabled at (1889470): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.249450] softirqs last disabled at (1889463): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.249452] ---[ end trace 0000000000000000 ]--- <6> [342.249454] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.249522] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.249528] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.249715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.249919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.250005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.250093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.250175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.250256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.250344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.250494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.250573] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.250665] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.250776] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.251779] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.262301] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.262558] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.263809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.263885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.263957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.264029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.264101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.264171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.264241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.264314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.264387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.264458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.264526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.264597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.264666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.264732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.264801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.264872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.264941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.265011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.265079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.265155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.265230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.265309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.265385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.265455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.265526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.265594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.265663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.265735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.265808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.265879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.265949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.266021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.266100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.266178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.266256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.266340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.266413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.266483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.266553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.266622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.266692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.266762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.266830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.266898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.266970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.267039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.267108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.267177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.267245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.267318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.267387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.267457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.267526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.267595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.267664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.267735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.267804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.267872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.267944] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.268060] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.268064] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16802, lrc_seqno=16802, guc_id=0, flags=0x73 in no process [-1] <7> [342.268066] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.268124] ------------[ cut here ]------------ <4> [342.268125] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.268126] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:9/208 <4> [342.268195] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.268253] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.268261] CPU: 8 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.268264] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.268265] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.268266] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.268271] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.268347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.268349] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.268351] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.268353] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.268354] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.268355] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.268356] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.268358] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.268359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.268361] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.268362] PKRU: 55555554 <4> [342.268363] Call Trace: <4> [342.268365] <TASK> <4> [342.268368] ? __pfx_lock_acquire+0x10/0x10 <4> [342.268373] ? lock_release+0xd0/0x2b0 <4> [342.268378] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.268384] process_one_work+0x22e/0x740 <4> [342.268391] worker_thread+0x1e8/0x3d0 <4> [342.268394] ? __pfx_worker_thread+0x10/0x10 <4> [342.268397] kthread+0x10d/0x150 <4> [342.268400] ? __pfx_kthread+0x10/0x10 <4> [342.268403] ret_from_fork+0x3d4/0x480 <4> [342.268406] ? __pfx_kthread+0x10/0x10 <4> [342.268409] ret_from_fork_asm+0x1a/0x30 <4> [342.268416] </TASK> <4> [342.268417] irq event stamp: 1892715 <4> [342.268418] hardirqs last enabled at (1892721): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.268420] hardirqs last disabled at (1892726): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.268422] softirqs last enabled at (1891568): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.268425] softirqs last disabled at (1891563): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.268426] ---[ end trace 0000000000000000 ]--- <6> [342.268428] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.268496] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.268502] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.269662] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.269764] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.269868] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.270080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.270173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.270266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.270365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.270447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.270527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.270607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.270683] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.270775] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.270895] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.271904] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.282304] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.282560] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.283790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.283866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.283939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.284012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.284084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.284155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.284226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.284308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.284379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.284449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.284517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.284586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.284654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.284722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.284791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.284861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.284929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.284997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.285064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.285142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.285218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.285292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.285389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.285463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.285535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.285603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.285671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.285741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.285815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.285886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.285957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.286030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.286107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.286184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.286261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.286345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.286419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.286490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.286560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.286630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.286703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.286773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.286842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.286909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.286982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.287052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.287120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.287190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.287258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.287339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.287409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.287481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.287552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.287623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.287692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.287761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.287830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.287900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.287972] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.288092] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.288096] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16802, lrc_seqno=16802, guc_id=0, flags=0x73 in no process [-1] <7> [342.288098] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.288156] ------------[ cut here ]------------ <4> [342.288157] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.288158] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119 <4> [342.288228] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.288287] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.288301] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.288303] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.288305] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.288306] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.288311] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.288380] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.288381] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.288384] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.288385] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.288386] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.288387] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.288388] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.288389] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.288391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.288392] CR2: 000072601fe8a000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.288394] PKRU: 55555554 <4> [342.288395] Call Trace: <4> [342.288396] <TASK> <4> [342.288399] ? __pfx_lock_acquire+0x10/0x10 <4> [342.288405] ? lock_release+0xd0/0x2b0 <4> [342.288410] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.288415] process_one_work+0x22e/0x740 <4> [342.288422] worker_thread+0x1e8/0x3d0 <4> [342.288425] ? __pfx_worker_thread+0x10/0x10 <4> [342.288428] kthread+0x10d/0x150 <4> [342.288431] ? __pfx_kthread+0x10/0x10 <4> [342.288434] ret_from_fork+0x3d4/0x480 <4> [342.288437] ? __pfx_kthread+0x10/0x10 <4> [342.288440] ret_from_fork_asm+0x1a/0x30 <4> [342.288446] </TASK> <4> [342.288447] irq event stamp: 924967 <4> [342.288449] hardirqs last enabled at (924973): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.288451] hardirqs last disabled at (924978): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.288453] softirqs last enabled at (923826): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.288455] softirqs last disabled at (923819): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.288457] ---[ end trace 0000000000000000 ]--- <7> [342.289803] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.289906] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.293757] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16810, lrc_seqno=16810, guc_id=0, flags=0x73 in no process [-1] <7> [342.293760] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.293824] ------------[ cut here ]------------ <4> [342.293825] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.293826] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119 <4> [342.293899] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.293959] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.293966] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.293969] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.293970] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.293971] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.293976] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.294047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.294048] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.294051] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.294052] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.294054] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.294055] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.294056] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.294058] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.294059] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.294061] CR2: 000072601fe8a000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.294062] PKRU: 55555554 <4> [342.294064] Call Trace: <4> [342.294065] <TASK> <4> [342.294069] ? __pfx_lock_acquire+0x10/0x10 <4> [342.294074] ? lock_release+0xd0/0x2b0 <4> [342.294079] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.294085] process_one_work+0x22e/0x740 <4> [342.294092] worker_thread+0x1e8/0x3d0 <4> [342.294095] ? __pfx_worker_thread+0x10/0x10 <4> [342.294098] kthread+0x10d/0x150 <4> [342.294101] ? __pfx_kthread+0x10/0x10 <4> [342.294104] ret_from_fork+0x3d4/0x480 <4> [342.294107] ? __pfx_kthread+0x10/0x10 <4> [342.294110] ret_from_fork_asm+0x1a/0x30 <4> [342.294117] </TASK> <4> [342.294119] irq event stamp: 926091 <4> [342.294120] hardirqs last enabled at (926097): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.294123] hardirqs last disabled at (926102): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.294125] softirqs last enabled at (923826): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.294127] softirqs last disabled at (923819): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.294129] ---[ end trace 0000000000000000 ]--- <6> [342.294131] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.294200] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.294207] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.294511] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.294713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.294800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.294889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.294971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.295052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.295131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.295209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.295285] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.295394] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.295517] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.296523] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.306305] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.306569] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.307881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.307957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.308028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.308099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.308169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.308236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.308310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.308379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.308447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.308516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.308585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.308652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.308735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.308803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.308872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.308941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.309008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.309076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.309142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.309220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.309300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.309373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.309445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.309515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.309585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.309655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.309726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.309798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.309871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.309942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.310013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.310085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.310161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.310237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.310317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.310391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.310464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.310534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.310604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.310673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.310746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.310816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.310885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.310953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.311027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.311098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.311171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.311240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.311317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.311387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.311457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.311529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.311598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.311668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.311736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.311805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.311875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.311945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.312018] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.312138] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.312142] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16810, lrc_seqno=16810, guc_id=0, flags=0x73 in no process [-1] <7> [342.312144] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.312202] ------------[ cut here ]------------ <4> [342.312203] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.312204] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119 <4> [342.312273] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.312337] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.312344] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.312347] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.312348] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.312349] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.312354] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.312421] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.312422] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.312424] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.312426] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.312427] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.312428] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.312429] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.312430] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.312432] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.312433] CR2: 000072601fe8a000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.312435] PKRU: 55555554 <4> [342.312436] Call Trace: <4> [342.312437] <TASK> <4> [342.312440] ? __pfx_lock_acquire+0x10/0x10 <4> [342.312445] ? lock_release+0xd0/0x2b0 <4> [342.312450] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.312456] process_one_work+0x22e/0x740 <4> [342.312462] worker_thread+0x1e8/0x3d0 <4> [342.312465] ? __pfx_worker_thread+0x10/0x10 <4> [342.312468] kthread+0x10d/0x150 <4> [342.312471] ? __pfx_kthread+0x10/0x10 <4> [342.312474] ret_from_fork+0x3d4/0x480 <4> [342.312477] ? __pfx_kthread+0x10/0x10 <4> [342.312480] ret_from_fork_asm+0x1a/0x30 <4> [342.312486] </TASK> <4> [342.312487] irq event stamp: 929145 <4> [342.312488] hardirqs last enabled at (929151): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.312491] hardirqs last disabled at (929156): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.312493] softirqs last enabled at (923826): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.312495] softirqs last disabled at (923819): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.312497] ---[ end trace 0000000000000000 ]--- <6> [342.312498] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.312566] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.312572] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.313632] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.313734] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.313837] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.314047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.314137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.314227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.314318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.314401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.314481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.314561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.314637] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.314729] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.314842] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.315848] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.326302] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.326559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.327858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.327937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.328010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.328084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.328155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.328226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.328308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.328379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.328449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.328517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.328585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.328651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.328719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.328787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.328856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.328924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.328991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.329059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.329127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.329205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.329280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.329368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.329442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.329514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.329586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.329656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.329725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.329798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.329871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.329941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.330012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.330084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.330160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.330237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.330320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.330397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.330469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.330539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.330610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.330677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.330749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.330819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.330889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.330958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.331031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.331099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.331167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.331236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.331313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.331382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.331451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.331523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.331592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.331662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.331730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.331801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.331867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.331935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.332005] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.332124] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.332128] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16810, lrc_seqno=16810, guc_id=0, flags=0x73 in no process [-1] <7> [342.332131] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.332187] ------------[ cut here ]------------ <4> [342.332188] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.332190] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204 <4> [342.332259] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.332324] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.332332] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.332335] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.332337] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.332338] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.332343] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.332411] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.332413] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.332415] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.332416] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.332417] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.332418] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.332419] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.332421] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [342.332422] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.332423] CR2: 00005fc3bfc30014 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [342.332425] PKRU: 55555554 <4> [342.332426] Call Trace: <4> [342.332427] <TASK> <4> [342.332431] ? __pfx_lock_acquire+0x10/0x10 <4> [342.332436] ? lock_release+0xd0/0x2b0 <4> [342.332441] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.332446] process_one_work+0x22e/0x740 <4> [342.332453] worker_thread+0x1e8/0x3d0 <4> [342.332457] ? __pfx_worker_thread+0x10/0x10 <4> [342.332460] kthread+0x10d/0x150 <4> [342.332462] ? __pfx_kthread+0x10/0x10 <4> [342.332465] ret_from_fork+0x3d4/0x480 <4> [342.332468] ? __pfx_kthread+0x10/0x10 <4> [342.332471] ret_from_fork_asm+0x1a/0x30 <4> [342.332478] </TASK> <4> [342.332479] irq event stamp: 1613845 <4> [342.332480] hardirqs last enabled at (1613851): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.332482] hardirqs last disabled at (1613856): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.332484] softirqs last enabled at (1612698): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.332486] softirqs last disabled at (1612689): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.332488] ---[ end trace 0000000000000000 ]--- <7> [342.333552] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.333654] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.335336] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16811, lrc_seqno=16811, guc_id=0, flags=0x73 in no process [-1] <7> [342.335339] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.335398] ------------[ cut here ]------------ <4> [342.335399] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.335401] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204 <4> [342.335470] Modules linked in: <7> [342.335469] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558] <4> [342.335530] xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec dm_multipath msr <4> [342.335590] nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.335596] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.335599] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.335600] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.335601] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.335606] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.335675] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.335677] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.335678] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.335680] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.335681] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.335682] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.335683] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.335684] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [342.335686] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.335687] CR2: 00005fc3bfc30014 CR3: 0000000122f7e001 CR4: 0000000000f72ef0 <4> [342.335688] PKRU: 55555554 <4> [342.335689] Call Trace: <4> [342.335690] <TASK> <4> [342.335694] ? __pfx_lock_acquire+0x10/0x10 <4> [342.335699] ? lock_release+0xd0/0x2b0 <4> [342.335704] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.335709] process_one_work+0x22e/0x740 <4> [342.335716] worker_thread+0x1e8/0x3d0 <4> [342.335719] ? __pfx_worker_thread+0x10/0x10 <4> [342.335722] kthread+0x10d/0x150 <4> [342.335724] ? __pfx_kthread+0x10/0x10 <4> [342.335727] ret_from_fork+0x3d4/0x480 <4> [342.335730] ? __pfx_kthread+0x10/0x10 <4> [342.335733] ret_from_fork_asm+0x1a/0x30 <4> [342.335740] </TASK> <4> [342.335741] irq event stamp: 1614739 <4> [342.335742] hardirqs last enabled at (1614745): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.335744] hardirqs last disabled at (1614750): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.335746] softirqs last enabled at (1612698): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.335748] softirqs last disabled at (1612689): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.335750] ---[ end trace 0000000000000000 ]--- <6> [342.335752] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.335819] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.335827] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.335981] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.336236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.336384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.336525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.336657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.336787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.336915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.337045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.337172] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.337326] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.337456] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.338475] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.348313] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.348592] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.349897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.349970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.350038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.350106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.350171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.350236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.350306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.350376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.350446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.350515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.350586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.350655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.350725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.350792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.350863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.350933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.351001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.351070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.351139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.351218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.351309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.351386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.351463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.351535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.351606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.351676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.351747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.351820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.351893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.351964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.352036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.352108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.352184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.352260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.352348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.352422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.352493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.352562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.352633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.352701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.352773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.352844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.352914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.352986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.353058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.353128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.353197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.353266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.353347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.353416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.353484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.353558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.353628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.353697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.353766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.353836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.353904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.353973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.354044] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.354160] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.354164] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16811, lrc_seqno=16811, guc_id=0, flags=0x73 in no process [-1] <7> [342.354167] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.354223] ------------[ cut here ]------------ <4> [342.354224] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.354226] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3882 <4> [342.354300] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.354360] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.354368] CPU: 2 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.354371] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.354372] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.354373] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.354378] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.354446] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.354448] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246 <4> [342.354450] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.354451] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.354452] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.354454] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.354455] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.354456] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [342.354457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.354459] CR2: 0000711c6c512000 CR3: 0000000122f7e004 CR4: 0000000000f72ef0 <4> [342.354460] PKRU: 55555554 <4> [342.354461] Call Trace: <4> [342.354462] <TASK> <4> [342.354466] ? __pfx_lock_acquire+0x10/0x10 <4> [342.354471] ? lock_release+0xd0/0x2b0 <4> [342.354476] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.354481] process_one_work+0x22e/0x740 <4> [342.354488] worker_thread+0x1e8/0x3d0 <4> [342.354492] ? __pfx_worker_thread+0x10/0x10 <4> [342.354495] kthread+0x10d/0x150 <4> [342.354497] ? __pfx_kthread+0x10/0x10 <4> [342.354500] ret_from_fork+0x3d4/0x480 <4> [342.354503] ? __pfx_kthread+0x10/0x10 <4> [342.354506] ret_from_fork_asm+0x1a/0x30 <4> [342.354512] </TASK> <4> [342.354513] irq event stamp: 900113 <4> [342.354515] hardirqs last enabled at (900119): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.354517] hardirqs last disabled at (900124): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.354519] softirqs last enabled at (898960): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.354521] softirqs last disabled at (898939): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.354523] ---[ end trace 0000000000000000 ]--- <6> [342.355315] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.355676] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.355697] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.355888] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.355989] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.356094] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.356305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.356394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.356483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.356566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.356646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.356737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.356817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.356895] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.356986] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.357098] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.358115] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.368303] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.368559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.369908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.369986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.370058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.370132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.370203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.370274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.370361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.370432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.370502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.370572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.370640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.370709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.370778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.370849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.370918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.370987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.371056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.371126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.371194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.371273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.371360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.371435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.371509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.371581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.371652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.371722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.371792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.371865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.371937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.372008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.372079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.372150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.372227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.372309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.372386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.372461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.372534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.372605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.372677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.372748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.372821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.372892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.372962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.373031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.373103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.373173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.373243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.373320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.373392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.373461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.373530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.373601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.373671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.373741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.373810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.373879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.373948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.374027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.374100] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.374222] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.374226] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16811, lrc_seqno=16811, guc_id=0, flags=0x73 in no process [-1] <7> [342.374229] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.374286] ------------[ cut here ]------------ <4> [342.374287] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.374288] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:16/3882 <4> [342.374377] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.374438] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.374445] CPU: 3 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.374448] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.374450] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.374451] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.374456] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.374524] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.374526] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246 <4> [342.374528] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.374529] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.374530] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.374531] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.374532] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.374534] FS: 0000000000000000(0000) GS:ffff8888dae1b000(0000) knlGS:0000000000000000 <4> [342.374535] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.374536] CR2: 00007a4ade891000 CR3: 00000001801f4004 CR4: 0000000000f72ef0 <4> [342.374538] PKRU: 55555554 <4> [342.374539] Call Trace: <4> [342.374540] <TASK> <4> [342.374544] ? __pfx_lock_acquire+0x10/0x10 <4> [342.374549] ? lock_release+0xd0/0x2b0 <4> [342.374554] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.374560] process_one_work+0x22e/0x740 <4> [342.374566] worker_thread+0x1e8/0x3d0 <4> [342.374569] ? __pfx_worker_thread+0x10/0x10 <4> [342.374572] kthread+0x10d/0x150 <4> [342.374575] ? __pfx_kthread+0x10/0x10 <4> [342.374578] ret_from_fork+0x3d4/0x480 <4> [342.374581] ? __pfx_kthread+0x10/0x10 <4> [342.374584] ret_from_fork_asm+0x1a/0x30 <4> [342.374591] </TASK> <4> [342.374592] irq event stamp: 903241 <4> [342.374593] hardirqs last enabled at (903247): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.374595] hardirqs last disabled at (903252): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.374597] softirqs last enabled at (902288): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.374599] softirqs last disabled at (902283): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.374601] ---[ end trace 0000000000000000 ]--- <7> [342.376059] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.376162] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.381106] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16827, lrc_seqno=16827, guc_id=0, flags=0x73 in no process [-1] <7> [342.381111] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.381184] ------------[ cut here ]------------ <4> [342.381185] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.381186] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.381266] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.381333] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.381341] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.381344] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.381345] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.381346] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.381352] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.381428] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.381430] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.381432] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.381434] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.381435] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.381436] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.381437] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.381438] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.381440] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.381441] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.381442] PKRU: 55555554 <4> [342.381443] Call Trace: <4> [342.381444] <TASK> <4> [342.381448] ? __pfx_lock_acquire+0x10/0x10 <4> [342.381454] ? lock_release+0xd0/0x2b0 <4> [342.381459] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.381464] process_one_work+0x22e/0x740 <4> [342.381471] worker_thread+0x1e8/0x3d0 <4> [342.381475] ? __pfx_worker_thread+0x10/0x10 <4> [342.381478] kthread+0x10d/0x150 <4> [342.381480] ? __pfx_kthread+0x10/0x10 <4> [342.381483] ret_from_fork+0x3d4/0x480 <4> [342.381487] ? __pfx_kthread+0x10/0x10 <4> [342.381490] ret_from_fork_asm+0x1a/0x30 <4> [342.381497] </TASK> <4> [342.381498] irq event stamp: 931447 <4> [342.381499] hardirqs last enabled at (931453): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.381502] hardirqs last disabled at (931458): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.381504] softirqs last enabled at (930898): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.381506] softirqs last disabled at (930891): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.381508] ---[ end trace 0000000000000000 ]--- <6> [342.381509] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.381585] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.381590] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.381870] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.382077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.382171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.382267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.382387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.382474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.382561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.382647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.382730] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.382828] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.382944] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.383954] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.394300] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.394562] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.395870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.395953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.396029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.396106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.396184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.396260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.396345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.396419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.396493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.396567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.396639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.396712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.396784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.396857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.396930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.397002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.397075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.397148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.397220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.397306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.397385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.397464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.397545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.397621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.397697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.397771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.397845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.397922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.398000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.398077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.398152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.398228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.398311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.398394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.398476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.398553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.398631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.398706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.398779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.398853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.398931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.399007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.399083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.399157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.399236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.399316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.399393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.399468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.399545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.399619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.399693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.399770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.399845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.399921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.399994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.400066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.400140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.400213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.400291] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.400434] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.400438] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16827, lrc_seqno=16827, guc_id=0, flags=0x73 in no process [-1] <7> [342.400440] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.400500] ------------[ cut here ]------------ <4> [342.400501] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.400502] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.400575] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.400634] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.400641] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.400644] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.400645] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.400646] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.400652] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.400723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.400725] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.400727] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.400728] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.400729] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.400730] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.400732] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.400733] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.400734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.400736] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.400737] PKRU: 55555554 <4> [342.400738] Call Trace: <4> [342.400739] <TASK> <4> [342.400743] ? __pfx_lock_acquire+0x10/0x10 <4> [342.400748] ? lock_release+0xd0/0x2b0 <4> [342.400753] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.400759] process_one_work+0x22e/0x740 <4> [342.400766] worker_thread+0x1e8/0x3d0 <4> [342.400769] ? __pfx_worker_thread+0x10/0x10 <4> [342.400772] kthread+0x10d/0x150 <4> [342.400775] ? __pfx_kthread+0x10/0x10 <4> [342.400778] ret_from_fork+0x3d4/0x480 <4> [342.400781] ? __pfx_kthread+0x10/0x10 <4> [342.400784] ret_from_fork_asm+0x1a/0x30 <4> [342.400790] </TASK> <4> [342.400791] irq event stamp: 934675 <4> [342.400792] hardirqs last enabled at (934681): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.400795] hardirqs last disabled at (934686): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.400797] softirqs last enabled at (933802): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.400799] softirqs last disabled at (933795): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.400801] ---[ end trace 0000000000000000 ]--- <6> [342.400802] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.400874] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.400880] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.401148] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.401356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.401442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.401531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.401615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.401699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.401783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.401866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.401945] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.402042] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.402159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.403165] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.413890] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.414150] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.415366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.415448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.415527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.415605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.415681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.415756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.415830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.415903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.415975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.416049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.416120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.416194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.416267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.416350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.416424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.416494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.416562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.416630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.416699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.416779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.416857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.416932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.417007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.417076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.417147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.417218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.417288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.417375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.417448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.417519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.417591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.417663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.417739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.417816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.417892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.417965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.418038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.418108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.418177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.418246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.418324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.418393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.418460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.418529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.418603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.418672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.418741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.418808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.418877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.418945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.419011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.419083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.419153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.419225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.419298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.419370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.419439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.419508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.419580] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.419696] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.419699] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16827, lrc_seqno=16827, guc_id=0, flags=0x73 in no process [-1] <7> [342.419702] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.419759] ------------[ cut here ]------------ <4> [342.419760] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.419761] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.419830] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.419887] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.419894] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.419897] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.419898] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.419899] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.419904] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.419972] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.419973] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.419975] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.419976] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.419978] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.419979] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.419980] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.419981] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.419982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.419984] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.419985] PKRU: 55555554 <4> [342.419986] Call Trace: <4> [342.419987] <TASK> <4> [342.419991] ? __pfx_lock_acquire+0x10/0x10 <4> [342.419995] ? lock_release+0xd0/0x2b0 <4> [342.420000] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.420006] process_one_work+0x22e/0x740 <4> [342.420012] worker_thread+0x1e8/0x3d0 <4> [342.420016] ? __pfx_worker_thread+0x10/0x10 <4> [342.420019] kthread+0x10d/0x150 <4> [342.420021] ? __pfx_kthread+0x10/0x10 <4> [342.420024] ret_from_fork+0x3d4/0x480 <4> [342.420027] ? __pfx_kthread+0x10/0x10 <4> [342.420030] ret_from_fork_asm+0x1a/0x30 <4> [342.420037] </TASK> <4> [342.420038] irq event stamp: 937771 <4> [342.420039] hardirqs last enabled at (937777): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.420041] hardirqs last disabled at (937782): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.420043] softirqs last enabled at (936866): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.420045] softirqs last disabled at (936859): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.420047] ---[ end trace 0000000000000000 ]--- <7> [342.421130] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.421233] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.422193] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16828, lrc_seqno=16828, guc_id=0, flags=0x73 in no process [-1] <7> [342.422196] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.422256] ------------[ cut here ]------------ <4> [342.422257] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.422258] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:1/119 <4> [342.422342] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.422400] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.422407] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.422410] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.422411] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.422412] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.422417] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.422487] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.422489] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.422491] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.422492] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.422493] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.422494] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.422495] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.422496] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.422498] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.422499] CR2: 000072601fe6f000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.422500] PKRU: 55555554 <4> [342.422502] Call Trace: <4> [342.422502] <TASK> <4> [342.422506] ? __pfx_lock_acquire+0x10/0x10 <4> [342.422511] ? lock_release+0xd0/0x2b0 <4> [342.422516] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.422521] process_one_work+0x22e/0x740 <4> [342.422528] worker_thread+0x1e8/0x3d0 <4> [342.422531] ? __pfx_worker_thread+0x10/0x10 <4> [342.422534] kthread+0x10d/0x150 <4> [342.422536] ? __pfx_kthread+0x10/0x10 <4> [342.422539] ret_from_fork+0x3d4/0x480 <4> [342.422542] ? __pfx_kthread+0x10/0x10 <4> [342.422545] ret_from_fork_asm+0x1a/0x30 <4> [342.422552] </TASK> <4> [342.422553] irq event stamp: 938823 <4> [342.422554] hardirqs last enabled at (938829): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.422556] hardirqs last disabled at (938834): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.422558] softirqs last enabled at (938050): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.422560] softirqs last disabled at (938037): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.422562] ---[ end trace 0000000000000000 ]--- <6> [342.422563] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.422632] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.422639] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.422856] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.423109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.423243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.423388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.423519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.423647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.423774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.423902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.424028] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.424166] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.424332] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.425654] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.436304] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.436620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.437991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.438108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.438223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.438345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.438464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.438580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.438697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.438813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.438929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.439045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.439161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.439277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.439423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.439540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.439657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.439773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.439889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.440005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.440122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.440242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.440369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.440489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.440610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.440729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.440848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.440967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.441086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.441208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.441334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.441455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.441577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.441698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.441826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.441953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.442079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.442204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.442332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.442453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.442573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.442693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.442815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.442936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.443057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.443175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.443304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.443424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.443544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.443663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.443784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.443903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.444021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.444144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.444264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.444387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.444507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.444627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.444746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.444865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.444988] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.445155] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.445162] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16828, lrc_seqno=16828, guc_id=0, flags=0x73 in no process [-1] <7> [342.445165] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.445263] ------------[ cut here ]------------ <4> [342.445265] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.445266] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:9/208 <4> [342.445380] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.445467] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.445478] CPU: 14 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.445482] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.445484] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.445486] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.445493] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.445601] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.445603] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.445606] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.445608] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.445610] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.445612] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.445613] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.445615] FS: 0000000000000000(0000) GS:ffff8888db39b000(0000) knlGS:0000000000000000 <4> [342.445617] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.445619] CR2: 00007a4ade891000 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [342.445621] PKRU: 55555554 <4> [342.445623] Call Trace: <4> [342.445624] <TASK> <4> [342.445631] ? __pfx_lock_acquire+0x10/0x10 <4> [342.445639] ? lock_release+0xd0/0x2b0 <4> [342.445647] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.445656] process_one_work+0x22e/0x740 <4> [342.445667] worker_thread+0x1e8/0x3d0 <4> [342.445672] ? __pfx_worker_thread+0x10/0x10 <4> [342.445676] kthread+0x10d/0x150 <4> [342.445679] ? __pfx_kthread+0x10/0x10 <4> [342.445684] ret_from_fork+0x3d4/0x480 <4> [342.445688] ? __pfx_kthread+0x10/0x10 <4> [342.445692] ret_from_fork_asm+0x1a/0x30 <4> [342.445704] </TASK> <4> [342.445705] irq event stamp: 1896203 <4> [342.445707] hardirqs last enabled at (1896209): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.445710] hardirqs last disabled at (1896214): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.445713] softirqs last enabled at (1895168): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.445716] softirqs last disabled at (1895163): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.445718] ---[ end trace 0000000000000000 ]--- <6> [342.445721] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.445829] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.445837] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.447631] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.447784] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.447936] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.448184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.448316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.448448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.448575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.448702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.448828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.448955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.449080] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.449216] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.449404] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.450748] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.461302] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.461617] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.463046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.463162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.463277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.463398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.463516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.463632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.463748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.463864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.463980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.464096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.464212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.464331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.464449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.464566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.464682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.464797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.464913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.465029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.465145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.465265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.465402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.465522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.465643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.465762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.465881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.465999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.466117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.466239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.466384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.466477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.466563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.466644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.466729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.466812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.466893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.466971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.467044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.467116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.467189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.467260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.467345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.467418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.467489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.467559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.467632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.467702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.467776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.467847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.467919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.467987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.468057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.468129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.468199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.468269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.468349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.468420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.468489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.468557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.468630] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.468751] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.468755] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16828, lrc_seqno=16828, guc_id=0, flags=0x73 in no process [-1] <7> [342.468757] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.468815] ------------[ cut here ]------------ <4> [342.468816] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.468817] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:9/208 <4> [342.468888] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.468951] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.468961] CPU: 10 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.468964] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.468966] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.468967] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.468972] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.469040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.469042] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.469045] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.469046] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.469048] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.469049] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.469051] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.469052] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [342.469054] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.469056] CR2: 00005fc3bfc30014 CR3: 0000000122f7e001 CR4: 0000000000f72ef0 <4> [342.469058] PKRU: 55555554 <4> [342.469059] Call Trace: <4> [342.469060] <TASK> <4> [342.469064] ? __pfx_lock_acquire+0x10/0x10 <4> [342.469070] ? lock_release+0xd0/0x2b0 <4> [342.469075] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.469080] process_one_work+0x22e/0x740 <4> [342.469087] worker_thread+0x1e8/0x3d0 <4> [342.469090] ? __pfx_worker_thread+0x10/0x10 <4> [342.469093] kthread+0x10d/0x150 <4> [342.469096] ? __pfx_kthread+0x10/0x10 <4> [342.469099] ret_from_fork+0x3d4/0x480 <4> [342.469102] ? __pfx_kthread+0x10/0x10 <4> [342.469105] ret_from_fork_asm+0x1a/0x30 <4> [342.469112] </TASK> <4> [342.469113] irq event stamp: 1899419 <4> [342.469114] hardirqs last enabled at (1899425): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.469116] hardirqs last disabled at (1899430): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.469118] softirqs last enabled at (1898514): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.469120] softirqs last disabled at (1898509): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.469122] ---[ end trace 0000000000000000 ]--- <7> [342.470478] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.470618] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.474527] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16836, lrc_seqno=16836, guc_id=0, flags=0x73 in no process [-1] <7> [342.474533] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.474637] ------------[ cut here ]------------ <4> [342.474639] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.474641] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:5/204 <4> [342.474754] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.474842] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.474853] CPU: 13 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.474857] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.474858] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.474860] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.474867] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.474977] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.474979] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.474982] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.474984] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.474986] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.474988] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.474989] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.474991] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [342.474993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.474995] CR2: 00007a351c2e7360 CR3: 0000000122f7e004 CR4: 0000000000f72ef0 <4> [342.474997] PKRU: 55555554 <4> [342.474999] Call Trace: <4> [342.475000] <TASK> <4> [342.475007] ? __pfx_lock_acquire+0x10/0x10 <4> [342.475015] ? lock_release+0xd0/0x2b0 <4> [342.475023] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.475032] process_one_work+0x22e/0x740 <4> [342.475043] worker_thread+0x1e8/0x3d0 <4> [342.475048] ? __pfx_worker_thread+0x10/0x10 <4> [342.475052] kthread+0x10d/0x150 <4> [342.475055] ? __pfx_kthread+0x10/0x10 <4> [342.475060] ret_from_fork+0x3d4/0x480 <4> [342.475064] ? __pfx_kthread+0x10/0x10 <4> [342.475068] ret_from_fork_asm+0x1a/0x30 <4> [342.475080] </TASK> <4> [342.475082] irq event stamp: 1616723 <4> [342.475083] hardirqs last enabled at (1616729): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.475087] hardirqs last disabled at (1616734): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.475089] softirqs last enabled at (1615588): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.475092] softirqs last disabled at (1615581): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.475095] ---[ end trace 0000000000000000 ]--- <6> [342.475097] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.475207] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.475215] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.475506] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.475758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.475888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.476021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.476150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.476278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.476411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.476540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.476667] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.476804] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.476965] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.478366] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.488303] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.488619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.490045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.490165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.490280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.490404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.490523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.490638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.490755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.490870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.490987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.491103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.491219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.491340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.491459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.491576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.491691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.491807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.491923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.492039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.492155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.492276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.492402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.492524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.492645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.492764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.492883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.493001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.493119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.493241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.493368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.493490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.493612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.493733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.493860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.493987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.494113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.494237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.494365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.494486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.494606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.494725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.494848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.494968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.495089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.495208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.495336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.495457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.495577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.495697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.495818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.495936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.496054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.496177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.496303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.496425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.496543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.496664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.496782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.496901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.497023] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.497190] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.497196] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16836, lrc_seqno=16836, guc_id=0, flags=0x73 in no process [-1] <7> [342.497199] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.498540] ------------[ cut here ]------------ <4> [342.498542] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.498544] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:5/204 <4> [342.498658] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.498743] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.498756] CPU: 13 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.498760] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.498761] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.498764] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.498772] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.498879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.498882] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.498885] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.498887] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.498889] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.498890] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.498892] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.498895] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000 <4> [342.498897] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.498899] CR2: 00007a351c2e7360 CR3: 0000000122f7e004 CR4: 0000000000f72ef0 <4> [342.498901] PKRU: 55555554 <4> [342.498903] Call Trace: <4> [342.498905] <TASK> <4> [342.498912] ? __pfx_lock_acquire+0x10/0x10 <4> [342.498920] ? lock_release+0xd0/0x2b0 <4> [342.498928] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.498937] process_one_work+0x22e/0x740 <4> [342.498948] worker_thread+0x1e8/0x3d0 <4> [342.498953] ? __pfx_worker_thread+0x10/0x10 <4> [342.498957] kthread+0x10d/0x150 <4> [342.498961] ? __pfx_kthread+0x10/0x10 <4> [342.498966] ret_from_fork+0x3d4/0x480 <4> [342.498970] ? __pfx_kthread+0x10/0x10 <4> [342.498974] ret_from_fork_asm+0x1a/0x30 <4> [342.498986] </TASK> <4> [342.498987] irq event stamp: 1619833 <4> [342.498989] hardirqs last enabled at (1619839): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.498992] hardirqs last disabled at (1619844): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.498994] softirqs last enabled at (1618908): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.498997] softirqs last disabled at (1618903): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.499000] ---[ end trace 0000000000000000 ]--- <6> [342.499002] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.499110] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.499119] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.499441] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.499591] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.499744] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.499991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.500116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.500247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.500382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.500511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.500637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.500764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.500889] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.501026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.501186] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.502601] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.513302] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.513617] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.515041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.515158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.515272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.515395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.515513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.515630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.515746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.515862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.515978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.516094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.516210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.516333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.516450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.516566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.516682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.516799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.516915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.517031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.517146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.517266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.517401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.517494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.517578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.517660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.517736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.517810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.517882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.517957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.518034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.518109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.518185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.518260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.518357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.518435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.518517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.518595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.518670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.518742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.518814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.518885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.518958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.519029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.519100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.519169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.519242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.519315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.519385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.519454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.519527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.519598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.519665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.519737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.519805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.519873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.519942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.520012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.520080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.520147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.520217] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.520348] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.520353] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16836, lrc_seqno=16836, guc_id=0, flags=0x73 in no process [-1] <7> [342.520355] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.520413] ------------[ cut here ]------------ <4> [342.520414] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.520416] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:5/204 <4> [342.520486] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.520545] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.520553] CPU: 2 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.520556] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.520557] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.520559] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.520564] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.520631] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.520633] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.520635] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.520636] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.520637] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.520639] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.520640] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.520641] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000 <4> [342.520642] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.520644] CR2: 0000711c6c512000 CR3: 0000000122f7e004 CR4: 0000000000f72ef0 <4> [342.520645] PKRU: 55555554 <4> [342.520646] Call Trace: <4> [342.520647] <TASK> <4> [342.520651] ? __pfx_lock_acquire+0x10/0x10 <4> [342.520656] ? lock_release+0xd0/0x2b0 <4> [342.520661] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.520667] process_one_work+0x22e/0x740 <4> [342.520673] worker_thread+0x1e8/0x3d0 <4> [342.520677] ? __pfx_worker_thread+0x10/0x10 <4> [342.520680] kthread+0x10d/0x150 <4> [342.520682] ? __pfx_kthread+0x10/0x10 <4> [342.520685] ret_from_fork+0x3d4/0x480 <4> [342.520688] ? __pfx_kthread+0x10/0x10 <4> [342.520691] ret_from_fork_asm+0x1a/0x30 <4> [342.520697] </TASK> <4> [342.520698] irq event stamp: 1622983 <4> [342.520700] hardirqs last enabled at (1622989): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.520702] hardirqs last disabled at (1622994): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.520704] softirqs last enabled at (1622134): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.520706] softirqs last disabled at (1622125): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.520708] ---[ end trace 0000000000000000 ]--- <7> [342.521801] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.521903] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.522914] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16837, lrc_seqno=16837, guc_id=0, flags=0x73 in no process [-1] <7> [342.522920] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.523024] ------------[ cut here ]------------ <4> [342.523026] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.523028] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:9/208 <4> [342.523142] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.523228] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.523239] CPU: 12 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.523243] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.523245] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.523246] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.523254] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.523371] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.523374] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.523377] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.523379] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.523381] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.523383] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.523384] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.523386] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000 <4> [342.523388] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.523390] CR2: 00007a351c29c848 CR3: 0000000122f7e006 CR4: 0000000000f72ef0 <4> [342.523392] PKRU: 55555554 <4> [342.523394] Call Trace: <4> [342.523395] <TASK> <4> [342.523401] ? __pfx_lock_acquire+0x10/0x10 <4> [342.523409] ? lock_release+0xd0/0x2b0 <4> [342.523418] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.523427] process_one_work+0x22e/0x740 <4> [342.523438] worker_thread+0x1e8/0x3d0 <4> [342.523443] ? __pfx_worker_thread+0x10/0x10 <4> [342.523447] kthread+0x10d/0x150 <4> [342.523451] ? __pfx_kthread+0x10/0x10 <4> [342.523456] ret_from_fork+0x3d4/0x480 <4> [342.523459] ? __pfx_kthread+0x10/0x10 <4> [342.523464] ret_from_fork_asm+0x1a/0x30 <4> [342.523476] </TASK> <4> [342.523477] irq event stamp: 1901523 <4> [342.523479] hardirqs last enabled at (1901529): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.523482] hardirqs last disabled at (1901534): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.523485] softirqs last enabled at (1900622): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.523488] softirqs last disabled at (1900613): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.523490] ---[ end trace 0000000000000000 ]--- <6> [342.523502] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.523582] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.523589] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.523876] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.524078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.524169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.524260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.524355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.524437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.524515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.524594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.524669] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.524761] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.524873] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.525881] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.526315] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:559] <7> [342.536298] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.536554] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.537763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.537836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.537902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.537968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.538033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.538095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.538158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.538219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.538284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.538369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.538443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.538513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.538583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.538653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.538721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.538790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.538859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.538929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.538998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.539077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.539154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.539228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.539306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.539379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.539450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.539521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.539591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.539664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.539737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.539809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.539879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.539951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.540028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.540106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.540185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.540260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.540342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.540415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.540485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.540553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.540625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.540696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.540765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.540834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.540908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.540976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.541046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.541116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.541187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.541253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.541329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.541402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.541471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.541539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.541608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.541681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.541751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.541819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.541891] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.542016] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.542333] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16837, lrc_seqno=16837, guc_id=0, flags=0x73 in no process [-1] <7> [342.542343] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.542683] ------------[ cut here ]------------ <4> [342.542686] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.542688] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:9/208 <4> [342.542904] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.542964] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.542972] CPU: 1 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.542975] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.542976] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.542977] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.542983] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [342.543010] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [342.543087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.543089] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.543092] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.543094] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.543096] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.543097] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.543099] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.543101] FS: 0000000000000000(0000) GS:ffff8888dad1b000(0000) knlGS:0000000000000000 <4> [342.543103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.543104] CR2: 00005a61f83233c8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.543106] PKRU: 55555554 <4> [342.543107] Call Trace: <4> [342.543109] <TASK> <4> [342.543114] ? __pfx_lock_acquire+0x10/0x10 <4> [342.543123] ? lock_release+0xd0/0x2b0 <4> [342.543131] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.543141] process_one_work+0x22e/0x740 <4> [342.543152] worker_thread+0x1e8/0x3d0 <4> [342.543157] ? __pfx_worker_thread+0x10/0x10 <4> [342.543162] kthread+0x10d/0x150 <4> [342.543166] ? __pfx_kthread+0x10/0x10 <4> [342.543171] ret_from_fork+0x3d4/0x480 <4> [342.543174] ? __pfx_kthread+0x10/0x10 <4> [342.543179] ret_from_fork_asm+0x1a/0x30 <4> [342.543189] </TASK> <4> [342.543191] irq event stamp: 1904603 <4> [342.543192] hardirqs last enabled at (1904609): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.543196] hardirqs last disabled at (1904614): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.543199] softirqs last enabled at (1903456): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.543202] softirqs last disabled at (1903449): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.543205] ---[ end trace 0000000000000000 ]--- <7> [342.543162] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [342.543208] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.543324] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.543332] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.543607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.543810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.543893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.543978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.544060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.544140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.544218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.544304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.544380] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.544468] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.544579] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.545585] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.556301] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.556557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.557854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.557930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.558001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.558073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.558144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.558213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.558281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.558366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.558436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.558505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.558574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.558642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.558710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.558780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.558849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.558919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.558988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.559058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.559124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.559204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.559279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.559367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.559441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.559510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.559579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.559650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.559720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.559791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.559866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.559939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.560010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.560082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.560159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.560236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.560318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.560391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.560461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.560528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.560598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.560665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.560736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.560805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.560874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.560942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.561015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.561084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.561153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.561222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.561296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.561364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.561431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.561502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.561569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.561638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.561705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.561776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.561845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.561913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.561984] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.562107] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.562111] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16837, lrc_seqno=16837, guc_id=0, flags=0x73 in no process [-1] <7> [342.562114] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.562171] ------------[ cut here ]------------ <4> [342.562172] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.562173] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:9/208 <4> [342.562243] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.562308] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.562316] CPU: 1 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.562318] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.562319] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.562321] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.562326] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.562395] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.562396] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.562398] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.562400] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.562401] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.562402] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.562403] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.562404] FS: 0000000000000000(0000) GS:ffff8888dad1b000(0000) knlGS:0000000000000000 <4> [342.562406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.562407] CR2: 00005a61f83233c8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.562409] PKRU: 55555554 <4> [342.562410] Call Trace: <4> [342.562411] <TASK> <4> [342.562414] ? __pfx_lock_acquire+0x10/0x10 <4> [342.562420] ? lock_release+0xd0/0x2b0 <4> [342.562425] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.562430] process_one_work+0x22e/0x740 <4> [342.562437] worker_thread+0x1e8/0x3d0 <4> [342.562440] ? __pfx_worker_thread+0x10/0x10 <4> [342.562443] kthread+0x10d/0x150 <4> [342.562446] ? __pfx_kthread+0x10/0x10 <4> [342.562449] ret_from_fork+0x3d4/0x480 <4> [342.562451] ? __pfx_kthread+0x10/0x10 <4> [342.562454] ret_from_fork_asm+0x1a/0x30 <4> [342.562461] </TASK> <4> [342.562462] irq event stamp: 1907693 <4> [342.562463] hardirqs last enabled at (1907699): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.562466] hardirqs last disabled at (1907704): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.562467] softirqs last enabled at (1906546): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.562470] softirqs last disabled at (1906541): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.562471] ---[ end trace 0000000000000000 ]--- <7> [342.563949] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.564056] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.568714] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16853, lrc_seqno=16853, guc_id=0, flags=0x73 in no process [-1] <7> [342.568719] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.568786] ------------[ cut here ]------------ <4> [342.568787] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.568788] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:16/3882 <4> [342.568864] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.568924] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.568932] CPU: 3 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.568935] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.568936] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.568937] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.568943] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.569015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.569017] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246 <4> [342.569019] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.569020] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.569021] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.569022] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.569023] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.569025] FS: 0000000000000000(0000) GS:ffff8888dae1b000(0000) knlGS:0000000000000000 <4> [342.569026] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.569027] CR2: 00007a4ade891000 CR3: 0000000122f7e002 CR4: 0000000000f72ef0 <4> [342.569029] PKRU: 55555554 <4> [342.569030] Call Trace: <4> [342.569031] <TASK> <4> [342.569035] ? __pfx_lock_acquire+0x10/0x10 <4> [342.569040] ? lock_release+0xd0/0x2b0 <4> [342.569045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.569050] process_one_work+0x22e/0x740 <4> [342.569057] worker_thread+0x1e8/0x3d0 <4> [342.569060] ? __pfx_worker_thread+0x10/0x10 <4> [342.569063] kthread+0x10d/0x150 <4> [342.569066] ? __pfx_kthread+0x10/0x10 <4> [342.569069] ret_from_fork+0x3d4/0x480 <4> [342.569072] ? __pfx_kthread+0x10/0x10 <4> [342.569075] ret_from_fork_asm+0x1a/0x30 <4> [342.569081] </TASK> <4> [342.569082] irq event stamp: 906003 <4> [342.569084] hardirqs last enabled at (906009): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.569086] hardirqs last disabled at (906014): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.569088] softirqs last enabled at (905154): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.569090] softirqs last disabled at (905149): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.569092] ---[ end trace 0000000000000000 ]--- <6> [342.569094] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.569165] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.569171] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.569454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.569657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.569746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.569835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.569918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.570001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.570081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.570162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.570238] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.570341] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.570454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.571476] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.581332] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.581590] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.582835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.582913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.582986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.583058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.583129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.583200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.583269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.583351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.583421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.583490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.583559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.583627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.583696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.583763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.583833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.583901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.583970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.584037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.584104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.584181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.584259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.584350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.584425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.584498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.584568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.584638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.584706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.584779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.584853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.584923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.584992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.585064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.585142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.585221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.585307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.585385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.585458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.585530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.585600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.585670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.585742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.585812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.585881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.585950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.586021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.586091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.586160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.586228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.586305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.586377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.586447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.586517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.586586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.586657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.586725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.586796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.586866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.586934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.587006] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.587128] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.587132] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16853, lrc_seqno=16853, guc_id=0, flags=0x73 in no process [-1] <7> [342.587135] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.587193] ------------[ cut here ]------------ <4> [342.587194] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.587195] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:16/3882 <4> [342.587265] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.587330] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.587337] CPU: 3 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.587340] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.587341] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.587343] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.587348] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.587415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.587417] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246 <4> [342.587419] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.587420] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.587421] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.587423] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.587424] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.587425] FS: 0000000000000000(0000) GS:ffff8888dae1b000(0000) knlGS:0000000000000000 <4> [342.587426] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.587428] CR2: 00007a4ade891000 CR3: 0000000122f7e002 CR4: 0000000000f72ef0 <4> [342.587429] PKRU: 55555554 <4> [342.587430] Call Trace: <4> [342.587431] <TASK> <4> [342.587435] ? __pfx_lock_acquire+0x10/0x10 <4> [342.587440] ? lock_release+0xd0/0x2b0 <4> [342.587445] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.587451] process_one_work+0x22e/0x740 <4> [342.587457] worker_thread+0x1e8/0x3d0 <4> [342.587461] ? __pfx_worker_thread+0x10/0x10 <4> [342.587464] kthread+0x10d/0x150 <4> [342.587466] ? __pfx_kthread+0x10/0x10 <4> [342.587469] ret_from_fork+0x3d4/0x480 <4> [342.587472] ? __pfx_kthread+0x10/0x10 <4> [342.587475] ret_from_fork_asm+0x1a/0x30 <4> [342.587482] </TASK> <4> [342.587483] irq event stamp: 909085 <4> [342.587484] hardirqs last enabled at (909091): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.587486] hardirqs last disabled at (909096): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.587488] softirqs last enabled at (908034): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.587490] softirqs last disabled at (908027): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.587492] ---[ end trace 0000000000000000 ]--- <6> [342.587494] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.587561] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.587567] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.588730] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.588833] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.588933] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.589144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.589235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.589334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.589418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.589498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.589577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.589659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.589736] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.589829] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.589940] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.590948] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.601648] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.601905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.603194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.603271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.603353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.603428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.603499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.603571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.603643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.603714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.603782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.603852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.603920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.603989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.604059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.604128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.604196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.604264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.604340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.604407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.604475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.604554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.604631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.604704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.604777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.604848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.604915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.604982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.605050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.605121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.605190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.605260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.605341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.605412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.605488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.605564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.605640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.605714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.605786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.605855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.605925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.605995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.606065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.606135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.606205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.606273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.606357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.606428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.606499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.606568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.606639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.606708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.606774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.606843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.606914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.606982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.607051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.607121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.607189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.607256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.607335] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.607455] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.607459] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16853, lrc_seqno=16853, guc_id=0, flags=0x73 in no process [-1] <7> [342.607461] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.607519] ------------[ cut here ]------------ <4> [342.607520] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.607521] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119 <4> [342.607591] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.607651] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.607658] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.607661] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.607662] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.607664] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.607669] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.607737] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.607739] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.607741] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.607742] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.607744] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.607745] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.607746] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.607747] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.607749] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.607750] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.607751] PKRU: 55555554 <4> [342.607752] Call Trace: <4> [342.607753] <TASK> <4> [342.607757] ? __pfx_lock_acquire+0x10/0x10 <4> [342.607762] ? lock_release+0xd0/0x2b0 <4> [342.607767] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.607773] process_one_work+0x22e/0x740 <4> [342.607780] worker_thread+0x1e8/0x3d0 <4> [342.607783] ? __pfx_worker_thread+0x10/0x10 <4> [342.607786] kthread+0x10d/0x150 <4> [342.607789] ? __pfx_kthread+0x10/0x10 <4> [342.607792] ret_from_fork+0x3d4/0x480 <4> [342.607794] ? __pfx_kthread+0x10/0x10 <4> [342.607797] ret_from_fork_asm+0x1a/0x30 <4> [342.607804] </TASK> <4> [342.607805] irq event stamp: 942447 <4> [342.607806] hardirqs last enabled at (942453): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.607808] hardirqs last disabled at (942458): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.607810] softirqs last enabled at (941360): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.607812] softirqs last disabled at (941353): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.607814] ---[ end trace 0000000000000000 ]--- <7> [342.608890] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.608993] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.609931] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16854, lrc_seqno=16854, guc_id=0, flags=0x73 in no process [-1] <7> [342.609937] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.610010] ------------[ cut here ]------------ <4> [342.610011] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.610012] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:9/208 <4> [342.610088] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.610147] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.610155] CPU: 11 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.610158] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.610159] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.610160] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.610166] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.610244] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.610246] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.610250] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.610252] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.610254] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.610256] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.610258] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.610260] FS: 0000000000000000(0000) GS:ffff8888db21b000(0000) knlGS:0000000000000000 <4> [342.610262] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.610264] CR2: 000000c000410000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.610267] PKRU: 55555554 <4> [342.610269] Call Trace: <4> [342.610270] <TASK> <4> [342.610277] ? __pfx_lock_acquire+0x10/0x10 <4> [342.610285] ? lock_release+0xd0/0x2b0 <4> [342.610300] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.610310] process_one_work+0x22e/0x740 <4> [342.610321] worker_thread+0x1e8/0x3d0 <4> [342.610325] ? __pfx_worker_thread+0x10/0x10 <4> [342.610328] kthread+0x10d/0x150 <4> [342.610331] ? __pfx_kthread+0x10/0x10 <4> [342.610334] ret_from_fork+0x3d4/0x480 <4> [342.610337] ? __pfx_kthread+0x10/0x10 <4> [342.610340] ret_from_fork_asm+0x1a/0x30 <4> [342.610347] </TASK> <4> [342.610348] irq event stamp: 1909699 <4> [342.610349] hardirqs last enabled at (1909705): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.610351] hardirqs last disabled at (1909710): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.610353] softirqs last enabled at (1909638): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.610356] softirqs last disabled at (1909633): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.610357] ---[ end trace 0000000000000000 ]--- <6> [342.610359] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.610431] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.610438] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.610698] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.610918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.611008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.611123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.611207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.611295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.611383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.611465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.611544] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.611638] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.611751] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.612759] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.623301] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.623562] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.624814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.624892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.624966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.625040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.625111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.625183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.625254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.625335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.625414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.625481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.625551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.625619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.625688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.625758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.625827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.625894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.625962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.626030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.626098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.626178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.626256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.626341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.626416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.626489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.626559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.626629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.626698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.626770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.626843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.626914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.626986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.627058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.627135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.627209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.627286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.627375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.627446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.627516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.627586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.627655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.627727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.627798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.627868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.627936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.628009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.628079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.628149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.628218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.628289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.628391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.628460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.628533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.628603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.628673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.628742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.628812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.628879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.628944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.629013] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.629132] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.629137] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16854, lrc_seqno=16854, guc_id=0, flags=0x73 in no process [-1] <7> [342.629139] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.629196] ------------[ cut here ]------------ <4> [342.629197] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.629199] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:9/208 <4> [342.629270] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.629336] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.629344] CPU: 11 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.629347] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.629348] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.629349] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.629354] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.629422] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.629424] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.629426] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.629427] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.629428] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.629430] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.629431] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.629432] FS: 0000000000000000(0000) GS:ffff8888db21b000(0000) knlGS:0000000000000000 <4> [342.629433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.629435] CR2: 000000c000410000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.629436] PKRU: 55555554 <4> [342.629437] Call Trace: <4> [342.629438] <TASK> <4> [342.629442] ? __pfx_lock_acquire+0x10/0x10 <4> [342.629448] ? lock_release+0xd0/0x2b0 <4> [342.629452] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.629458] process_one_work+0x22e/0x740 <4> [342.629465] worker_thread+0x1e8/0x3d0 <4> [342.629468] ? __pfx_worker_thread+0x10/0x10 <4> [342.629471] kthread+0x10d/0x150 <4> [342.629473] ? __pfx_kthread+0x10/0x10 <4> [342.629477] ret_from_fork+0x3d4/0x480 <4> [342.629479] ? __pfx_kthread+0x10/0x10 <4> [342.629482] ret_from_fork_asm+0x1a/0x30 <4> [342.629489] </TASK> <4> [342.629490] irq event stamp: 1912843 <4> [342.629491] hardirqs last enabled at (1912849): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.629493] hardirqs last disabled at (1912854): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.629495] softirqs last enabled at (1911902): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.629497] softirqs last disabled at (1911811): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.629499] ---[ end trace 0000000000000000 ]--- <6> [342.630430] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.630501] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.630517] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.630580] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.630679] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.630779] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.630981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.631066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.631152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.631232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.631317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.631395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.631473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.631558] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.631650] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.631761] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.632776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.643300] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.643557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.644823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.644903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.644977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.645051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.645123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.645194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.645264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.645350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.645422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.645492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.645561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.645632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.645708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.645778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.645845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.645915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.645982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.646051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.646145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.646249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.646352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.646430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.646505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.646577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.646648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.646719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.646788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.646858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.646929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.646999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.647070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.647142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.647218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.647299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.647375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.647450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.647524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.647594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.647665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.647734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.647807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.647878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.647957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.648027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.648102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.648175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.648245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.648325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.648395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.648463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.648532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.648605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.648677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.648749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.648819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.648890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.648959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.649028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.649100] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.649219] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.649222] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16854, lrc_seqno=16854, guc_id=0, flags=0x73 in no process [-1] <7> [342.649225] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.649282] ------------[ cut here ]------------ <4> [342.649283] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.649284] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:9/208 <4> [342.649370] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.649428] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.649436] CPU: 11 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.649439] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.649440] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.649441] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.649446] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.649514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.649515] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.649517] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.649519] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.649520] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.649521] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.649522] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.649523] FS: 0000000000000000(0000) GS:ffff8888db21b000(0000) knlGS:0000000000000000 <4> [342.649525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.649526] CR2: 000000c000410000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.649527] PKRU: 55555554 <4> [342.649528] Call Trace: <4> [342.649530] <TASK> <4> [342.649533] ? __pfx_lock_acquire+0x10/0x10 <4> [342.649539] ? lock_release+0xd0/0x2b0 <4> [342.649543] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.649549] process_one_work+0x22e/0x740 <4> [342.649556] worker_thread+0x1e8/0x3d0 <4> [342.649559] ? __pfx_worker_thread+0x10/0x10 <4> [342.649562] kthread+0x10d/0x150 <4> [342.649564] ? __pfx_kthread+0x10/0x10 <4> [342.649568] ret_from_fork+0x3d4/0x480 <4> [342.649570] ? __pfx_kthread+0x10/0x10 <4> [342.649573] ret_from_fork_asm+0x1a/0x30 <4> [342.649580] </TASK> <4> [342.649581] irq event stamp: 1915961 <4> [342.649582] hardirqs last enabled at (1915967): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.649584] hardirqs last disabled at (1915972): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.649586] softirqs last enabled at (1914808): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.649588] softirqs last disabled at (1914801): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.649590] ---[ end trace 0000000000000000 ]--- <7> [342.650651] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.650754] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.655459] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16862, lrc_seqno=16862, guc_id=0, flags=0x73 in no process [-1] <7> [342.655463] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.655525] ------------[ cut here ]------------ <4> [342.655527] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.655528] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119 <4> [342.655602] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.655661] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.655668] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.655671] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.655672] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.655673] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.655679] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.655748] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.655750] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.655752] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.655754] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.655755] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.655756] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.655757] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.655758] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.655760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.655761] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.655763] PKRU: 55555554 <4> [342.655764] Call Trace: <4> [342.655765] <TASK> <4> [342.655769] ? __pfx_lock_acquire+0x10/0x10 <4> [342.655774] ? lock_release+0xd0/0x2b0 <4> [342.655779] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.655784] process_one_work+0x22e/0x740 <4> [342.655791] worker_thread+0x1e8/0x3d0 <4> [342.655794] ? __pfx_worker_thread+0x10/0x10 <4> [342.655797] kthread+0x10d/0x150 <4> [342.655800] ? __pfx_kthread+0x10/0x10 <4> [342.655803] ret_from_fork+0x3d4/0x480 <4> [342.655806] ? __pfx_kthread+0x10/0x10 <4> [342.655809] ret_from_fork_asm+0x1a/0x30 <4> [342.655815] </TASK> <4> [342.655816] irq event stamp: 944055 <4> [342.655818] hardirqs last enabled at (944061): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.655820] hardirqs last disabled at (944066): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.655822] softirqs last enabled at (942884): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.655824] softirqs last disabled at (942877): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.655826] ---[ end trace 0000000000000000 ]--- <6> [342.655828] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.655897] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.655902] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.656182] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.656388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.656476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.656566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.656649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.656729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.656805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.656882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.656958] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.657051] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.657164] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.658169] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.668298] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.668554] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.669850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.669926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.669996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.670069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.670141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.670211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.670279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.670387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.670457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.670525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.670593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.670662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.670730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.670798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.670867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.670933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.671001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.671070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.671136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.671214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.671296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.671369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.671444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.671515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.671585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.671655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.671725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.671799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.671872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.671943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.672015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.672087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.672166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.672245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.672344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.672422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.672497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.672569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.672640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.672711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.672784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.672855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.672926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.672997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.673071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.673139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.673211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.673281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.673367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.673437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.673506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.673579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.673650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.673721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.673791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.673863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.673933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.674002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.674072] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.674192] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.674196] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16862, lrc_seqno=16862, guc_id=0, flags=0x73 in no process [-1] <7> [342.674199] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.674256] ------------[ cut here ]------------ <4> [342.674257] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.674258] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119 <4> [342.674340] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.674399] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.674407] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.674409] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.674410] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.674412] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.674417] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.674485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.674486] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.674488] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.674490] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.674491] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.674492] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.674493] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.674494] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.674496] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.674497] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.674499] PKRU: 55555554 <4> [342.674500] Call Trace: <4> [342.674501] <TASK> <4> [342.674504] ? __pfx_lock_acquire+0x10/0x10 <4> [342.674509] ? lock_release+0xd0/0x2b0 <4> [342.674514] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.674519] process_one_work+0x22e/0x740 <4> [342.674526] worker_thread+0x1e8/0x3d0 <4> [342.674530] ? __pfx_worker_thread+0x10/0x10 <4> [342.674533] kthread+0x10d/0x150 <4> [342.674535] ? __pfx_kthread+0x10/0x10 <4> [342.674538] ret_from_fork+0x3d4/0x480 <4> [342.674541] ? __pfx_kthread+0x10/0x10 <4> [342.674544] ret_from_fork_asm+0x1a/0x30 <4> [342.674551] </TASK> <4> [342.674552] irq event stamp: 947259 <4> [342.674553] hardirqs last enabled at (947265): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.674555] hardirqs last disabled at (947270): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.674557] softirqs last enabled at (946486): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.674559] softirqs last disabled at (946481): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.674561] ---[ end trace 0000000000000000 ]--- <6> [342.675303] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.675432] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.675443] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.675617] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.675717] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.675818] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.676023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.676113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.676203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.676286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.676385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.676468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.676549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.676626] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.676730] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.676842] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.677849] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.688566] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.688823] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.690078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.690154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.690226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.690306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.690378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.690449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.690517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.690587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.690656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.690725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.690795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.690865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.690935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.691005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.691075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.691144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.691213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.691281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.691366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.691443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.691519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.691591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.691666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.691738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.691809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.691879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.691948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.692022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.692096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.692169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.692242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.692322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.692399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.692476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.692553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.692628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.692702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.692772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.692841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.692910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.692983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.693054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.693124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.693192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.693265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.693345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.693416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.693483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.693552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.693619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.693688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.693759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.693829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.693900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.693968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.694038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.694107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.694175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.694245] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.694376] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.694380] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16862, lrc_seqno=16862, guc_id=0, flags=0x73 in no process [-1] <7> [342.694383] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.694440] ------------[ cut here ]------------ <4> [342.694441] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.694443] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/119 <4> [342.694512] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.694572] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.694580] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.694583] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.694584] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.694585] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.694590] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.694658] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.694660] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.694662] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.694663] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.694665] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.694666] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.694667] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.694668] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [342.694669] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.694671] CR2: 00005fc3bfc30014 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [342.694672] PKRU: 55555554 <4> [342.694673] Call Trace: <4> [342.694674] <TASK> <4> [342.694678] ? __pfx_lock_acquire+0x10/0x10 <4> [342.694683] ? lock_release+0xd0/0x2b0 <4> [342.694688] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.694694] process_one_work+0x22e/0x740 <4> [342.694701] worker_thread+0x1e8/0x3d0 <4> [342.694704] ? __pfx_worker_thread+0x10/0x10 <4> [342.694707] kthread+0x10d/0x150 <4> [342.694710] ? __pfx_kthread+0x10/0x10 <4> [342.694713] ret_from_fork+0x3d4/0x480 <4> [342.694716] ? __pfx_kthread+0x10/0x10 <4> [342.694719] ret_from_fork_asm+0x1a/0x30 <4> [342.694726] </TASK> <4> [342.694727] irq event stamp: 950383 <4> [342.694728] hardirqs last enabled at (950389): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.694730] hardirqs last disabled at (950394): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.694732] softirqs last enabled at (949304): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.694734] softirqs last disabled at (949297): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.694736] ---[ end trace 0000000000000000 ]--- <7> [342.695823] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.695958] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.697110] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16863, lrc_seqno=16863, guc_id=0, flags=0x73 in no process [-1] <7> [342.697113] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.697172] ------------[ cut here ]------------ <4> [342.697173] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.697174] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204 <4> [342.697245] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core <7> [342.697258] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:560] <4> [342.697263] drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.697320] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.697323] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.697324] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.697325] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.697330] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.697398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.697400] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.697402] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.697403] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.697404] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.697405] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.697406] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.697407] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.697409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.697410] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.697411] PKRU: 55555554 <4> [342.697412] Call Trace: <4> [342.697413] <TASK> <4> [342.697417] ? __pfx_lock_acquire+0x10/0x10 <4> [342.697422] ? lock_release+0xd0/0x2b0 <4> [342.697426] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.697431] process_one_work+0x22e/0x740 <4> [342.697438] worker_thread+0x1e8/0x3d0 <4> [342.697441] ? __pfx_worker_thread+0x10/0x10 <4> [342.697444] kthread+0x10d/0x150 <4> [342.697447] ? __pfx_kthread+0x10/0x10 <4> [342.697450] ret_from_fork+0x3d4/0x480 <4> [342.697452] ? __pfx_kthread+0x10/0x10 <4> [342.697455] ret_from_fork_asm+0x1a/0x30 <4> [342.697462] </TASK> <4> [342.697463] irq event stamp: 1625579 <4> [342.697464] hardirqs last enabled at (1625585): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.697466] hardirqs last disabled at (1625590): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.697468] softirqs last enabled at (1625180): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.697470] softirqs last disabled at (1625173): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.697472] ---[ end trace 0000000000000000 ]--- <6> [342.697474] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.697542] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.697548] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.697599] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.697801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.697889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.697977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.698097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.698194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.698273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.698369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.698448] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.698577] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.698688] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.699697] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.710299] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.710554] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.711846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.711925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.711998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.712068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.712140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.712211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.712281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.712364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.712435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.712505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.712574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.712645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.712714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.712783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.712851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.712919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.712986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.713052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.713119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.713197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.713273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.713359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.713435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.713507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.713579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.713649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.713721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.713793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.713866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.713938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.714011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.714083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.714160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.714237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.714335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.714410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.714482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.714550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.714620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.714688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.714760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.714832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.714902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.714972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.715045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.715113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.715180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.715250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.715328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.715397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.715466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.715537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.715607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.715675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.715743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.715812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.715880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.715947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.716016] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.716135] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.716139] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16863, lrc_seqno=16863, guc_id=0, flags=0x73 in no process [-1] <7> [342.716141] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.716198] ------------[ cut here ]------------ <4> [342.716199] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.716201] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/119 <4> [342.716270] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.716334] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.716342] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.716345] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.716346] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.716347] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.716352] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.716420] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.716422] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.716424] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.716425] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.716426] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.716427] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.716428] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.716430] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000 <4> [342.716431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.716432] CR2: 00005fc3bfc30014 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [342.716434] PKRU: 55555554 <4> [342.716435] Call Trace: <4> [342.716436] <TASK> <4> [342.716440] ? __pfx_lock_acquire+0x10/0x10 <4> [342.716445] ? lock_release+0xd0/0x2b0 <4> [342.716450] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.716455] process_one_work+0x22e/0x740 <4> [342.716462] worker_thread+0x1e8/0x3d0 <4> [342.716465] ? __pfx_worker_thread+0x10/0x10 <4> [342.716468] kthread+0x10d/0x150 <4> [342.716470] ? __pfx_kthread+0x10/0x10 <4> [342.716474] ret_from_fork+0x3d4/0x480 <4> [342.716476] ? __pfx_kthread+0x10/0x10 <4> [342.716479] ret_from_fork_asm+0x1a/0x30 <4> [342.716486] </TASK> <4> [342.716487] irq event stamp: 953741 <4> [342.716488] hardirqs last enabled at (953747): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.716491] hardirqs last disabled at (953752): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.716493] softirqs last enabled at (952794): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.716495] softirqs last disabled at (952787): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.716497] ---[ end trace 0000000000000000 ]--- <6> [342.717313] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.717477] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.717484] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.717562] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.717662] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.717764] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.717966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.718050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.718136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.718216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.718302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.718380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.718458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.718532] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.718621] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.718734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.719742] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.730463] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.730719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.731988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.732065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.732137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.732207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.732278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.732364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.732435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.732505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.732576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.732646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.732714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.732783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.732852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.732921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.732990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.733059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.733128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.733197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.733267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.733353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.733430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.733503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.733578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.733650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.733722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.733795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.733866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.733939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.734014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.734087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.734159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.734231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.734310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.734388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.734463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.734538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.734610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.734679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.734749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.734817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.734887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.734959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.735029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.735099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.735172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.735241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.735316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.735386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.735455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.735523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.735591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.735663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.735734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.735805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.735873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.735944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.736013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.736083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.736153] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.736274] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.736278] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16863, lrc_seqno=16863, guc_id=0, flags=0x73 in no process [-1] <7> [342.736280] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.736357] ------------[ cut here ]------------ <4> [342.736358] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.736360] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:1/119 <4> [342.736430] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.736489] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.736497] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.736500] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.736501] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.736502] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.736507] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.736575] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.736577] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.736579] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.736580] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.736581] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.736583] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.736584] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.736585] FS: 0000000000000000(0000) GS:ffff8888db21b000(0000) knlGS:0000000000000000 <4> [342.736586] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.736587] CR2: 000000c000410000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.736589] PKRU: 55555554 <4> [342.736590] Call Trace: <4> [342.736591] <TASK> <4> [342.736595] ? __pfx_lock_acquire+0x10/0x10 <4> [342.736600] ? lock_release+0xd0/0x2b0 <4> [342.736605] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.736610] process_one_work+0x22e/0x740 <4> [342.736617] worker_thread+0x1e8/0x3d0 <4> [342.736620] ? __pfx_worker_thread+0x10/0x10 <4> [342.736623] kthread+0x10d/0x150 <4> [342.736626] ? __pfx_kthread+0x10/0x10 <4> [342.736629] ret_from_fork+0x3d4/0x480 <4> [342.736632] ? __pfx_kthread+0x10/0x10 <4> [342.736635] ret_from_fork_asm+0x1a/0x30 <4> [342.736641] </TASK> <4> [342.736642] irq event stamp: 956843 <4> [342.736643] hardirqs last enabled at (956849): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.736646] hardirqs last disabled at (956854): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.736648] softirqs last enabled at (955772): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.736650] softirqs last disabled at (955767): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.736652] ---[ end trace 0000000000000000 ]--- <7> [342.738139] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.738244] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.742908] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16879, lrc_seqno=16879, guc_id=0, flags=0x73 in no process [-1] <7> [342.742912] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.742977] ------------[ cut here ]------------ <4> [342.742978] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.742980] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:9/208 <4> [342.743054] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.743114] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.743122] CPU: 1 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.743125] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.743126] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.743127] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.743132] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.743202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.743204] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.743206] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.743207] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.743208] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.743209] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.743210] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.743212] FS: 0000000000000000(0000) GS:ffff8888dad1b000(0000) knlGS:0000000000000000 <4> [342.743213] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.743214] CR2: 00005a61f83233c8 CR3: 0000000122f7e001 CR4: 0000000000f72ef0 <4> [342.743216] PKRU: 55555554 <4> [342.743217] Call Trace: <4> [342.743218] <TASK> <4> [342.743222] ? __pfx_lock_acquire+0x10/0x10 <4> [342.743227] ? lock_release+0xd0/0x2b0 <4> [342.743232] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.743238] process_one_work+0x22e/0x740 <4> [342.743245] worker_thread+0x1e8/0x3d0 <4> [342.743248] ? __pfx_worker_thread+0x10/0x10 <4> [342.743251] kthread+0x10d/0x150 <4> [342.743254] ? __pfx_kthread+0x10/0x10 <4> [342.743257] ret_from_fork+0x3d4/0x480 <4> [342.743259] ? __pfx_kthread+0x10/0x10 <4> [342.743262] ret_from_fork_asm+0x1a/0x30 <4> [342.743269] </TASK> <4> [342.743270] irq event stamp: 1918033 <4> [342.743271] hardirqs last enabled at (1918039): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.743274] hardirqs last disabled at (1918044): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.743276] softirqs last enabled at (1917164): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.743278] softirqs last disabled at (1917159): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.743280] ---[ end trace 0000000000000000 ]--- <6> [342.743282] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.743373] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.743379] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.743681] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.743885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.743970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.744056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.744137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.744215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.744301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.744380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.744456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.744547] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.744675] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.745681] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.756297] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.756553] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.757795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.757870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.757942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.758014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.758084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.758155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.758225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.758298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.758367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.758437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.758508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.758577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.758646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.758714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.758782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.758851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.758918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.758985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.759055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.759130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.759206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.759279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.759366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.759437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.759508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.759579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.759650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.759724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.759797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.759869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.759942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.760014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.760091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.760168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.760246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.760327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.760402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.760472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.760542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.760612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.760684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.760753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.760821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.760888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.760960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.761030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.761099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.761168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.761239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.761315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.761384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.761456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.761525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.761595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.761663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.761733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.761800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.761868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.761939] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.762058] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.762061] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16879, lrc_seqno=16879, guc_id=0, flags=0x73 in no process [-1] <7> [342.762064] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.762121] ------------[ cut here ]------------ <4> [342.762121] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.762123] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:1/119 <4> [342.762192] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.762251] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.762259] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.762262] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.762263] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.762264] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.762269] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.762345] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.762347] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [342.762349] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.762351] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.762352] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.762353] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.762355] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.762356] FS: 0000000000000000(0000) GS:ffff8888db21b000(0000) knlGS:0000000000000000 <4> [342.762358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.762359] CR2: 000000c000410000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.762361] PKRU: 55555554 <4> [342.762362] Call Trace: <4> [342.762363] <TASK> <4> [342.762367] ? __pfx_lock_acquire+0x10/0x10 <4> [342.762372] ? lock_release+0xd0/0x2b0 <4> [342.762377] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.762382] process_one_work+0x22e/0x740 <4> [342.762389] worker_thread+0x1e8/0x3d0 <4> [342.762392] ? __pfx_worker_thread+0x10/0x10 <4> [342.762395] kthread+0x10d/0x150 <4> [342.762398] ? __pfx_kthread+0x10/0x10 <4> [342.762401] ret_from_fork+0x3d4/0x480 <4> [342.762404] ? __pfx_kthread+0x10/0x10 <4> [342.762407] ret_from_fork_asm+0x1a/0x30 <4> [342.762414] </TASK> <4> [342.762415] irq event stamp: 960515 <4> [342.762416] hardirqs last enabled at (960521): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.762419] hardirqs last disabled at (960526): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.762420] softirqs last enabled at (959574): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.762422] softirqs last disabled at (959561): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.762424] ---[ end trace 0000000000000000 ]--- <6> [342.762426] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.762494] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.762499] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.763655] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.763755] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.763856] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.764059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.764146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.764235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.764327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.764408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.764489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.764570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.764649] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.764741] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.764852] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.765858] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.776579] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.776835] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.778151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.778227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.778305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.778377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.778450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.778522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.778593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.778660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.778730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.778798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.778868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.778938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.779007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.779076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.779143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.779213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.779282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.779364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.779434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.779513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.779589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.779660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.779733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.779805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.779878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.779950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.780021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.780094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.780167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.780239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.780316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.780389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.780469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.780546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.780623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.780697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.780769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.780839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.780912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.780982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.781054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.781123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.781192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.781260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.781339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.781407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.781476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.781544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.781614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.781680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.781748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.781819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.781886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.781955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.782024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.782094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.782162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.782230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.782304] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.782424] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.782428] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16879, lrc_seqno=16879, guc_id=0, flags=0x73 in no process [-1] <7> [342.782430] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.782486] ------------[ cut here ]------------ <4> [342.782487] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.782489] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204 <4> [342.782557] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.782615] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.782623] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.782625] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.782626] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.782628] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.782633] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.782699] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.782701] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.782703] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.782704] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.782706] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.782707] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.782708] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.782709] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.782710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.782712] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.782713] PKRU: 55555554 <4> [342.782714] Call Trace: <4> [342.782715] <TASK> <4> [342.782719] ? __pfx_lock_acquire+0x10/0x10 <4> [342.782724] ? lock_release+0xd0/0x2b0 <4> [342.782729] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.782734] process_one_work+0x22e/0x740 <4> [342.782741] worker_thread+0x1e8/0x3d0 <4> [342.782744] ? __pfx_worker_thread+0x10/0x10 <4> [342.782747] kthread+0x10d/0x150 <4> [342.782750] ? __pfx_kthread+0x10/0x10 <4> [342.782753] ret_from_fork+0x3d4/0x480 <4> [342.782756] ? __pfx_kthread+0x10/0x10 <4> [342.782759] ret_from_fork_asm+0x1a/0x30 <4> [342.782766] </TASK> <4> [342.782767] irq event stamp: 1629239 <4> [342.782768] hardirqs last enabled at (1629245): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.782770] hardirqs last disabled at (1629250): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.782772] softirqs last enabled at (1628358): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.782774] softirqs last disabled at (1628347): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.782776] ---[ end trace 0000000000000000 ]--- <7> [342.783850] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.783952] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.784915] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16880, lrc_seqno=16880, guc_id=0, flags=0x73 in no process [-1] <7> [342.784920] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.784983] ------------[ cut here ]------------ <4> [342.784985] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.784986] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3882 <4> [342.785062] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.785121] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.785129] CPU: 8 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.785132] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.785133] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.785135] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.785140] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.785210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.785212] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246 <4> [342.785214] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.785215] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.785217] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.785218] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.785219] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.785220] FS: 0000000000000000(0000) GS:ffff8888db09b000(0000) knlGS:0000000000000000 <4> [342.785221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.785223] CR2: 000072601fe6f000 CR3: 000000011c043003 CR4: 0000000000f72ef0 <4> [342.785224] PKRU: 55555554 <4> [342.785225] Call Trace: <4> [342.785226] <TASK> <4> [342.785230] ? __pfx_lock_acquire+0x10/0x10 <4> [342.785235] ? lock_release+0xd0/0x2b0 <4> [342.785240] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.785246] process_one_work+0x22e/0x740 <4> [342.785253] worker_thread+0x1e8/0x3d0 <4> [342.785256] ? __pfx_worker_thread+0x10/0x10 <4> [342.785259] kthread+0x10d/0x150 <4> [342.785261] ? __pfx_kthread+0x10/0x10 <4> [342.785265] ret_from_fork+0x3d4/0x480 <4> [342.785267] ? __pfx_kthread+0x10/0x10 <4> [342.785270] ret_from_fork_asm+0x1a/0x30 <4> [342.785277] </TASK> <4> [342.785278] irq event stamp: 910595 <4> [342.785279] hardirqs last enabled at (910601): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.785282] hardirqs last disabled at (910606): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.785284] softirqs last enabled at (909538): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70 <4> [342.785285] softirqs last disabled at (909536): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120 <4> [342.785288] ---[ end trace 0000000000000000 ]--- <6> [342.785295] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.785365] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.785372] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.785650] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.785866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.785952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.786039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.786121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.786211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.786294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.786374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.786451] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.786543] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.786654] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.787658] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.798297] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.798553] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.799846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.799922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.799994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.800066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.800136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.800206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.800274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.800359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.800429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.800498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.800567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.800636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.800705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.800772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.800839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.800907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.800976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.801044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.801110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.801186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.801262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.801360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.801436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.801508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.801580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.801649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.801720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.801793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.801866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.801937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.802009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.802082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.802159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.802235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.802317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.802392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.802465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.802536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.802607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.802676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.802749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.802820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.802890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.802959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.803032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.803099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.803167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.803235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.803323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.803391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.803458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.803528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.803598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.803668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.803738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.803809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.803877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.803945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.804017] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.804133] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.804137] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16880, lrc_seqno=16880, guc_id=0, flags=0x73 in no process [-1] <7> [342.804139] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.804196] ------------[ cut here ]------------ <4> [342.804197] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.804199] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204 <4> [342.804269] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.804333] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.804341] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.804344] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.804345] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.804346] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.804351] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.804420] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.804421] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.804423] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.804425] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.804426] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.804427] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.804428] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.804429] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.804431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.804432] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.804433] PKRU: 55555554 <4> [342.804434] Call Trace: <4> [342.804435] <TASK> <4> [342.804439] ? __pfx_lock_acquire+0x10/0x10 <4> [342.804444] ? lock_release+0xd0/0x2b0 <4> [342.804449] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.804454] process_one_work+0x22e/0x740 <4> [342.804461] worker_thread+0x1e8/0x3d0 <4> [342.804464] ? __pfx_worker_thread+0x10/0x10 <4> [342.804467] kthread+0x10d/0x150 <4> [342.804470] ? __pfx_kthread+0x10/0x10 <4> [342.804473] ret_from_fork+0x3d4/0x480 <4> [342.804475] ? __pfx_kthread+0x10/0x10 <4> [342.804478] ret_from_fork_asm+0x1a/0x30 <4> [342.804485] </TASK> <4> [342.804486] irq event stamp: 1632461 <4> [342.804487] hardirqs last enabled at (1632467): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.804490] hardirqs last disabled at (1632472): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.804491] softirqs last enabled at (1631514): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.804494] softirqs last disabled at (1631449): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.804496] ---[ end trace 0000000000000000 ]--- <6> [342.804497] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.804565] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.804570] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.804851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.805051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.805137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.805226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.805316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.805398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.805477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.805556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.805633] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.805725] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.805837] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.806846] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.817298] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.817555] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.818876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.818951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.819024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.819096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.819168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.819238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.819316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.819386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.819455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.819524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.819594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.819663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.819732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.819800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.819867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.819935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.820001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.820070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.820135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.820213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.820295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.820369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.820443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.820514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.820585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.820654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.820724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.820797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.820870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.820942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.821014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.821087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.821164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.821239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.821324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.821400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.821474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.821545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.821616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.821688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.821763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.821834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.821906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.821977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.822051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.822121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.822192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.822264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.822347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.822418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.822488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.822559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.822630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.822701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.822771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.822841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.822910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.822980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.823052] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.823171] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.823175] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16880, lrc_seqno=16880, guc_id=0, flags=0x73 in no process [-1] <7> [342.823177] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.823233] ------------[ cut here ]------------ <4> [342.823234] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.823235] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204 <4> [342.823309] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.823368] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.823375] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.823378] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.823379] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.823380] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.823385] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.823452] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.823453] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.823455] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.823457] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.823458] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.823459] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.823460] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.823461] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.823463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.823464] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.823465] PKRU: 55555554 <4> [342.823466] Call Trace: <4> [342.823467] <TASK> <4> [342.823471] ? __pfx_lock_acquire+0x10/0x10 <4> [342.823475] ? lock_release+0xd0/0x2b0 <4> [342.823480] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.823486] process_one_work+0x22e/0x740 <4> [342.823492] worker_thread+0x1e8/0x3d0 <4> [342.823496] ? __pfx_worker_thread+0x10/0x10 <4> [342.823499] kthread+0x10d/0x150 <4> [342.823501] ? __pfx_kthread+0x10/0x10 <4> [342.823504] ret_from_fork+0x3d4/0x480 <4> [342.823507] ? __pfx_kthread+0x10/0x10 <4> [342.823510] ret_from_fork_asm+0x1a/0x30 <4> [342.823517] </TASK> <4> [342.823518] irq event stamp: 1635599 <4> [342.823519] hardirqs last enabled at (1635605): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.823521] hardirqs last disabled at (1635610): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.823523] softirqs last enabled at (1634826): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.823525] softirqs last disabled at (1634821): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.823527] ---[ end trace 0000000000000000 ]--- <7> [342.824590] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.824691] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [342.829509] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16888, lrc_seqno=16888, guc_id=0, flags=0x73 in no process [-1] <7> [342.829513] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.829576] ------------[ cut here ]------------ <4> [342.829578] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.829579] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:9/208 <4> [342.829654] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.829713] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.829720] CPU: 1 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.829723] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.829724] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.829725] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.829730] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.829801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.829803] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [342.829805] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.829806] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.829808] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.829809] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.829810] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.829811] FS: 0000000000000000(0000) GS:ffff8888dad1b000(0000) knlGS:0000000000000000 <4> [342.829812] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.829814] CR2: 00005a61f83233c8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [342.829815] PKRU: 55555554 <4> [342.829816] Call Trace: <4> [342.829817] <TASK> <4> [342.829821] ? __pfx_lock_acquire+0x10/0x10 <4> [342.829826] ? lock_release+0xd0/0x2b0 <4> [342.829831] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.829836] process_one_work+0x22e/0x740 <4> [342.829843] worker_thread+0x1e8/0x3d0 <4> [342.829846] ? __pfx_worker_thread+0x10/0x10 <4> [342.829849] kthread+0x10d/0x150 <4> [342.829852] ? __pfx_kthread+0x10/0x10 <4> [342.829855] ret_from_fork+0x3d4/0x480 <4> [342.829857] ? __pfx_kthread+0x10/0x10 <4> [342.829860] ret_from_fork_asm+0x1a/0x30 <4> [342.829867] </TASK> <4> [342.829868] irq event stamp: 1919775 <4> [342.829869] hardirqs last enabled at (1919781): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.829872] hardirqs last disabled at (1919786): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.829873] softirqs last enabled at (1918808): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70 <4> [342.829875] softirqs last disabled at (1918806): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120 <4> [342.829877] ---[ end trace 0000000000000000 ]--- <6> [342.829879] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.829948] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.829954] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.830233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.830444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.830530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.830617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.830698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.830778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.830856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.830936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.831013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.831105] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.831215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.832215] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.842299] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.842566] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.843880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.843958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.844030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.844103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.844174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.844245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.844344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.844414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.844483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.844552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.844621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.844690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.844758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.844826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.844895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.844964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.845033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.845101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.845169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.845248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.845336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.845409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.845483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.845554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.845625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.845698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.845770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.845843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.845916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.845987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.846059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.846131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.846209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.846293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.846371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.846447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.846520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.846590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.846660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.846730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.846803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.846875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.846947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.847016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.847089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.847160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.847230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.847305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.847376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.847445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.847515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.847589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.847661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.847733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.847802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.847873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.847942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.848011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.848083] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.848202] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.848206] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16888, lrc_seqno=16888, guc_id=0, flags=0x73 in no process [-1] <7> [342.848209] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.848266] ------------[ cut here ]------------ <4> [342.848267] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.848268] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204 <4> [342.848348] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.848407] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.848414] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.848417] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.848418] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.848419] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.848424] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.848492] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.848494] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.848496] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.848497] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.848499] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.848500] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.848501] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.848502] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.848503] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.848505] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.848506] PKRU: 55555554 <4> [342.848507] Call Trace: <4> [342.848508] <TASK> <4> [342.848512] ? __pfx_lock_acquire+0x10/0x10 <4> [342.848517] ? lock_release+0xd0/0x2b0 <4> [342.848522] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.848527] process_one_work+0x22e/0x740 <4> [342.848534] worker_thread+0x1e8/0x3d0 <4> [342.848537] ? __pfx_worker_thread+0x10/0x10 <4> [342.848540] kthread+0x10d/0x150 <4> [342.848543] ? __pfx_kthread+0x10/0x10 <4> [342.848546] ret_from_fork+0x3d4/0x480 <4> [342.848548] ? __pfx_kthread+0x10/0x10 <4> [342.848551] ret_from_fork_asm+0x1a/0x30 <4> [342.848558] </TASK> <4> [342.848559] irq event stamp: 1639119 <4> [342.848560] hardirqs last enabled at (1639125): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.848563] hardirqs last disabled at (1639130): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.848564] softirqs last enabled at (1638166): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.848566] softirqs last disabled at (1638161): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.848568] ---[ end trace 0000000000000000 ]--- <6> [342.848570] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [342.848638] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [342.848644] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [342.848944] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [342.849144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [342.849225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [342.849315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [342.849396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [342.849473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [342.849550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [342.849628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [342.849702] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [342.849795] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [342.849907] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [342.850910] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [342.861636] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [342.861887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [342.863311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [342.863390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [342.863456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [342.863519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [342.863584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [342.863647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [342.863711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [342.863774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [342.863834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [342.863896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [342.863958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [342.864022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [342.864085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [342.864145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [342.864210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [342.864279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [342.864363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [342.864432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [342.864501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [342.864579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [342.864655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [342.864729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [342.864804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [342.864873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [342.864942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [342.865010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [342.865078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [342.865148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [342.865219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [342.865293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [342.865365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [342.865437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [342.865514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [342.865591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [342.865668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [342.865741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [342.865813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [342.865880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [342.865950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [342.866020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [342.866091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [342.866160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [342.866230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [342.866299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [342.866374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [342.866444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [342.866512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [342.866580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [342.866649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [342.866717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [342.866785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [342.866857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [342.866925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [342.866994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [342.867062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [342.867131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [342.867198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [342.867265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [342.867344] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [342.867458] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [342.867462] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16888, lrc_seqno=16888, guc_id=0, flags=0x73 in no process [-1] <7> [342.867464] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [342.867521] ------------[ cut here ]------------ <4> [342.867522] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [342.867523] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204 <4> [342.867591] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec <4> [342.867649] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [342.867656] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy) <4> [342.867658] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [342.867659] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [342.867661] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [342.867666] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [342.867733] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [342.867734] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246 <4> [342.867736] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000 <4> [342.867738] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60 <4> [342.867739] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [342.867740] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [342.867741] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2 <4> [342.867742] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000 <4> [342.867744] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [342.867745] CR2: 00007a4ade891000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [342.867746] PKRU: 55555554 <4> [342.867747] Call Trace: <4> [342.867748] <TASK> <4> [342.867752] ? __pfx_lock_acquire+0x10/0x10 <4> [342.867757] ? lock_release+0xd0/0x2b0 <4> [342.867762] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [342.867767] process_one_work+0x22e/0x740 <4> [342.867774] worker_thread+0x1e8/0x3d0 <4> [342.867777] ? __pfx_worker_thread+0x10/0x10 <4> [342.867780] kthread+0x10d/0x150 <4> [342.867782] ? __pfx_kthread+0x10/0x10 <4> [342.867786] ret_from_fork+0x3d4/0x480 <4> [342.867788] ? __pfx_kthread+0x10/0x10 <4> [342.867791] ret_from_fork_asm+0x1a/0x30 <4> [342.867798] </TASK> <4> [342.867799] irq event stamp: 1642293 <4> [342.867800] hardirqs last enabled at (1642299): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0 <4> [342.867802] hardirqs last disabled at (1642304): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0 <4> [342.867804] softirqs last enabled at (1641312): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.867806] softirqs last disabled at (1641305): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160 <4> [342.867808] ---[ end trace 0000000000000000 ]--- <7> [342.868891] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [342.868993] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [342.869895] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 0) -> ( 0 - 1989), size 0 -> 1989 <7> [342.869990] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [342.870071] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [342.870148] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 <7> [342.870220] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 <7> [342.870331] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:386:pipe C] data rate 594000 num active planes 1 <7> [342.870435] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [342.870535] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [342.870632] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [342.875584] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 1989) -> ( 0 - 123), size 1989 -> 123 <7> [342.875686] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [342.875767] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0 <7> [342.875844] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 -> 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0 <7> [342.875919] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 -> 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [342.876005] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] No SAGV, use UINT_MAX as peak bw. <6> [344.876509] [IGT] kms_async_flips: finished subtest pipe-C-HDMI-A-3-4, SUCCESS

<7> [342.148671] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<4> [342.159440] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass

<4> [342.159539] snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [342.159809] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.180585] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.180733] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.199886] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.200028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.207506] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.207648] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.226474] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.226616] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.246803] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.246949] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.249223] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.249376] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.268195] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.268347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.288228] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.288380] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.293899] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.294047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.312273] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.312421] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.332259] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.332411] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.335530] xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec dm_multipath msr

<4> [342.335675] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.354300] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.354446] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.374377] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.374524] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.381266] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.381428] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.400575] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.400723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.419830] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.419972] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.422342] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.422487] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.445380] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.445601] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.468888] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.469040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.474754] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.474977] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.498658] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.498879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.520486] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.520631] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.523142] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.523371] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.542904] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.543087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.562243] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.562395] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.568864] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.569015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.587265] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.587415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.607591] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.607737] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.610088] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.610244] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.629270] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.629422] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.649370] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.649514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.655602] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.655748] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.674340] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.674485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.694512] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.694658] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.697245] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core

<4> [342.697263] drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [342.697398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.716270] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.716420] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.736430] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.736575] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.743054] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.743202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.762192] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.762345] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.782557] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.782699] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.785062] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.785210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.804269] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.804420] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.823309] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.823452] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.829654] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.829801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.848348] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.848492] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [342.867591] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec

<4> [342.867733] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<7> [342.869990] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [342.875686] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

Results for igt@kms_async_flips@async-flip-with-page-flip-events-tiled@pipe-c-hdmi-a-3-4