igt@kms_async_flips@async-flip-with-page-flip-events-tiled@pipe-c-hdmi-a-3-4 on shard-bmg@xe-4424-b7c3274a57563fc1652889043a6e8d08473e5f31 Test details

Detail	Value
Duration	2.73 seconds
Hostname	shard-bmg-3
Igt-Version	IGT-Version: 2.3-g16ce286ca (x86_64) (Linux: 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ x86_64)
Out	Starting dynamic subtest: pipe-C-HDMI-A-3-4 Dynamic subtest pipe-C-HDMI-A-3-4: SUCCESS (2.729s)
Err	Starting dynamic subtest: pipe-C-HDMI-A-3-4 Dynamic subtest pipe-C-HDMI-A-3-4: SUCCESS (2.729s)
Dmesg Scroll to first warning	<6> [526.173726] [IGT] kms_async_flips: starting dynamic subtest pipe-C-HDMI-A-3-4 <7> [526.174305] xe 0000:03:00.0: [drm:drm_mode_rmfb_work_fn] Removing [FB:554] from all active usage due to RMFB ioctl <7> [526.174349] xe 0000:03:00.0: [drm:atomic_remove_fb] Disabling [PLANE:269:plane 1C] because [FB:554] is removed <7> [526.174384] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:269:plane 1C] ddb ( 0 - 123) -> ( 0 - 0), size 123 -> 0 <7> [526.174522] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [526.174662] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] lines 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [526.174789] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] blocks 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [526.174893] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] min_ddb 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [526.175012] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:385:pipe C] data rate 0 num active planes 0 <7> [526.175145] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 0 qgv_peak_bw: 48000 <7> [526.175270] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 0 qgv_peak_bw: 48000 <7> [526.175389] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 0 <5> [526.186111] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10756, lrc_seqno=10756, guc_id=0, flags=0x73 in no process [-1] <7> [526.186123] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.186326] ------------[ cut here ]------------ <4> [526.186329] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.186333] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#5: kworker/u64:388/11019 <7> [526.186474] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:554] <4> [526.186513] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.186680] efi_pstore nfnetlink autofs4 <4> [526.186691] CPU: 5 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.186699] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.186701] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.186704] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.186717] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.186867] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.186871] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.186876] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.186879] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.186881] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.186884] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.186886] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.186889] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [526.186892] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.186894] CR2: 0000652fc0bde9b8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.186898] PKRU: 55555554 <4> [526.186900] Call Trace: <4> [526.186903] <TASK> <4> [526.186915] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.186926] ? lock_release+0xce/0x280 <4> [526.186939] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.186950] process_one_work+0x22e/0x6b0 <4> [526.186964] worker_thread+0x1e8/0x3d0 <4> [526.186969] ? __pfx_worker_thread+0x10/0x10 <4> [526.186974] kthread+0x11f/0x250 <4> [526.186982] ? __pfx_kthread+0x10/0x10 <4> [526.186989] ret_from_fork+0x344/0x3a0 <4> [526.186994] ? __pfx_kthread+0x10/0x10 <4> [526.187001] ret_from_fork_asm+0x1a/0x30 <4> [526.187018] </TASK> <4> [526.187020] irq event stamp: 753875 <4> [526.187023] hardirqs last enabled at (753881): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.187029] hardirqs last disabled at (753886): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.187034] softirqs last enabled at (753456): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.187039] softirqs last disabled at (753451): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.187045] ---[ end trace 0000000000000000 ]--- <6> [526.187049] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.187195] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.187216] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.187273] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.187569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.187803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.187976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.188135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.188290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.188446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.188630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.188843] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.189029] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.189295] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.190562] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.201437] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.201752] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.203172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.203265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.203346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.203426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.203504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.203582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.203676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.203752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.203824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.203895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.203967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.204038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.204108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.204177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.204245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.204311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.204378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.204444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.204512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.204588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.204677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.204749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.204820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.204889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.204958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.205028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.205102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.205173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.205243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.205312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.205397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.205525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.205649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.205761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.205876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.205994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.206109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.206219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.206323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.206402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.206473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.206542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.206614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.206689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.206758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.206826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.206892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.206959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.207024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.207091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.207159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.207226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.207293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.207357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.207424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.207490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.207555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.207630] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.207747] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.208598] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10756, lrc_seqno=10756, guc_id=0, flags=0x73 in no process [-1] <7> [526.208605] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.208662] ------------[ cut here ]------------ <4> [526.208664] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.208665] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#5: kworker/u64:388/11019 <4> [526.208737] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.208800] efi_pstore nfnetlink autofs4 <4> [526.208804] CPU: 5 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.208808] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.208809] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.208810] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.208815] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.208879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.208881] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.208883] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.208885] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.208886] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.208887] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.208888] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.208889] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [526.208890] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.208892] CR2: 0000652fc0bde9b8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.208893] PKRU: 55555554 <4> [526.208894] Call Trace: <4> [526.208895] <TASK> <4> [526.208900] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.208905] ? lock_release+0xce/0x280 <4> [526.208911] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.208915] process_one_work+0x22e/0x6b0 <4> [526.208922] worker_thread+0x1e8/0x3d0 <4> [526.208925] ? __pfx_worker_thread+0x10/0x10 <4> [526.208927] kthread+0x11f/0x250 <4> [526.208930] ? __pfx_kthread+0x10/0x10 <4> [526.208934] ret_from_fork+0x344/0x3a0 <4> [526.208936] ? __pfx_kthread+0x10/0x10 <4> [526.208939] ret_from_fork_asm+0x1a/0x30 <4> [526.208947] </TASK> <4> [526.208948] irq event stamp: 756963 <4> [526.208949] hardirqs last enabled at (756969): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.208952] hardirqs last disabled at (756974): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.208954] softirqs last enabled at (755920): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.208957] softirqs last disabled at (755911): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.208959] ---[ end trace 0000000000000000 ]--- <6> [526.208961] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.209026] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [526.209043] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.209140] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [526.209232] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.209512] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.209711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.209794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.209878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.209957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.210034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.210110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.210188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.210263] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.210350] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.210457] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.211465] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.221611] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.221871] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.223181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.223248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.223312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.223376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.223437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.223496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.223556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.223622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.223691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.223759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.223826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.223893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.223957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.224023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.224086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.224151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.224214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.224276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.224339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.224413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.224487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.224558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.224640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.224709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.224781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.224851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.224926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.224997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.225070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.225142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.225213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.225289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.225365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.225439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.225510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.225580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.225662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.225740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.225816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.225897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.225965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.226032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.226098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.226167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.226233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.226299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.226364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.226431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.226496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.226561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.226639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.226707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.226773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.226840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.226908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.226972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.227036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.227104] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.227224] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.227642] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10756, lrc_seqno=10756, guc_id=0, flags=0x73 in no process [-1] <7> [526.227649] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.227963] ------------[ cut here ]------------ <4> [526.227966] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.227968] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#4: kworker/u64:388/11019 <4> [526.228116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.228178] efi_pstore nfnetlink autofs4 <4> [526.228182] CPU: 4 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.228185] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.228186] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.228187] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.228193] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <7> [526.228210] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [526.228300] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.228302] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.228305] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.228307] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.228308] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.228310] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.228311] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.228312] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [526.228315] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.228316] CR2: 0000652fc0bdce78 CR3: 0000000150a21001 CR4: 0000000000f72ef0 <4> [526.228318] PKRU: 55555554 <4> [526.228320] Call Trace: <4> [526.228321] <TASK> <4> [526.228331] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.228339] ? lock_release+0xce/0x280 <4> [526.228348] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.228358] process_one_work+0x22e/0x6b0 <4> [526.228368] worker_thread+0x1e8/0x3d0 <4> [526.228372] ? __pfx_worker_thread+0x10/0x10 <4> [526.228375] kthread+0x11f/0x250 <4> [526.228379] ? __pfx_kthread+0x10/0x10 <4> [526.228384] ret_from_fork+0x344/0x3a0 <4> [526.228387] ? __pfx_kthread+0x10/0x10 <4> [526.228391] ret_from_fork_asm+0x1a/0x30 <4> [526.228404] </TASK> <4> [526.228406] irq event stamp: 760053 <4> [526.228408] hardirqs last enabled at (760059): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.228412] hardirqs last disabled at (760064): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.228415] softirqs last enabled at (759148): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.228419] softirqs last disabled at (759141): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.228422] ---[ end trace 0000000000000000 ]--- <7> [526.228355] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.234628] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10772, lrc_seqno=10772, guc_id=0, flags=0x73 in no process [-1] <7> [526.234632] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.234693] ------------[ cut here ]------------ <4> [526.234694] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.234695] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#10: kworker/u64:391/11022 <4> [526.234769] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.234831] efi_pstore nfnetlink autofs4 <4> [526.234835] CPU: 10 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.234838] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.234839] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.234840] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.234845] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.234912] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.234913] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.234915] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.234917] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.234918] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.234919] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.234920] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.234921] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [526.234922] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.234924] CR2: 0000652fc0be1478 CR3: 0000000003448003 CR4: 0000000000f72ef0 <4> [526.234925] PKRU: 55555554 <4> [526.234926] Call Trace: <4> [526.234927] <TASK> <4> [526.234932] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.234937] ? lock_release+0xce/0x280 <4> [526.234943] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.234948] process_one_work+0x22e/0x6b0 <4> [526.234954] worker_thread+0x1e8/0x3d0 <4> [526.234956] ? __pfx_worker_thread+0x10/0x10 <4> [526.234958] kthread+0x11f/0x250 <4> [526.234961] ? __pfx_kthread+0x10/0x10 <4> [526.234965] ret_from_fork+0x344/0x3a0 <4> [526.234967] ? __pfx_kthread+0x10/0x10 <4> [526.234970] ret_from_fork_asm+0x1a/0x30 <4> [526.234977] </TASK> <4> [526.234978] irq event stamp: 906755 <4> [526.234979] hardirqs last enabled at (906761): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.234982] hardirqs last disabled at (906766): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.234984] softirqs last enabled at (905794): [<ffffffff813346a3>] kernel_fpu_end+0x53/0x70 <4> [526.234986] softirqs last disabled at (905792): [<ffffffff81334d84>] kernel_fpu_begin_mask+0xc4/0x120 <4> [526.234989] ---[ end trace 0000000000000000 ]--- <6> [526.234991] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.235059] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.235064] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.235333] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.235534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.235628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.235755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.235851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.235946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.236023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.236100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.236175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.236274] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.236382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.237398] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.247610] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.247866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.249131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.249197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.249260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.249322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.249384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.249445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.249507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.249570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.249648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.249723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.249789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.249855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.249921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.249987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.250054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.250118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.250184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.250249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.250314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.250388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.250460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.250529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.250598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.250686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.250767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.250835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.250908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.250978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.251047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.251115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.251181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.251253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.251328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.251399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.251468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.251535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.251598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.251686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.251764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.251835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.251901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.251966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.252031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.252099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.252169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.252238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.252304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.252372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.252436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.252502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.252569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.252654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.252733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.252797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.252863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.252928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.252992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.253059] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.253175] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.254037] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10772, lrc_seqno=10772, guc_id=0, flags=0x73 in no process [-1] <7> [526.254040] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.254097] ------------[ cut here ]------------ <4> [526.254098] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.254099] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#10: kworker/u64:391/11022 <4> [526.254167] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.254226] efi_pstore nfnetlink autofs4 <4> [526.254230] CPU: 10 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.254232] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.254233] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.254235] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.254240] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.254304] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.254306] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.254308] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.254309] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.254310] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.254311] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.254312] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.254314] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [526.254315] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.254316] CR2: 0000652fc0be1478 CR3: 0000000003448003 CR4: 0000000000f72ef0 <4> [526.254318] PKRU: 55555554 <4> [526.254319] Call Trace: <4> [526.254320] <TASK> <4> [526.254325] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.254329] ? lock_release+0xce/0x280 <4> [526.254335] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.254339] process_one_work+0x22e/0x6b0 <4> [526.254345] worker_thread+0x1e8/0x3d0 <4> [526.254348] ? __pfx_worker_thread+0x10/0x10 <4> [526.254350] kthread+0x11f/0x250 <4> [526.254353] ? __pfx_kthread+0x10/0x10 <4> [526.254356] ret_from_fork+0x344/0x3a0 <4> [526.254359] ? __pfx_kthread+0x10/0x10 <4> [526.254361] ret_from_fork_asm+0x1a/0x30 <4> [526.254369] </TASK> <4> [526.254370] irq event stamp: 909897 <4> [526.254371] hardirqs last enabled at (909903): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.254373] hardirqs last disabled at (909908): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.254375] softirqs last enabled at (909000): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.254378] softirqs last disabled at (908977): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.254380] ---[ end trace 0000000000000000 ]--- <6> [526.254382] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.254446] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.254451] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.254735] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.254847] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.254948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.255149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.255227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.255309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.255385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.255461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.255537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.255623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.255703] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.255789] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.255898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.256913] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.267610] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.267864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.269130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.269196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.269259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.269321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.269383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.269443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.269505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.269565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.269643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.269718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.269784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.269850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.269915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.269980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.270045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.270111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.270176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.270243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.270309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.270383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.270455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.270525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.270594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.270685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.270765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.270835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.270906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.270975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.271042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.271110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.271178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.271250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.271322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.271395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.271464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.271531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.271596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.271684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.271767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.271835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.271900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.271968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.272033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.272103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.272167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.272230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.272294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.272359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.272422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.272485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.272553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.272629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.272711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.272778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.272845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.272909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.272973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.273039] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.273156] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.274010] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10772, lrc_seqno=10772, guc_id=0, flags=0x73 in no process [-1] <7> [526.274013] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.274071] ------------[ cut here ]------------ <4> [526.274072] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.274073] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#10: kworker/u64:391/11022 <4> [526.274140] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.274198] efi_pstore nfnetlink autofs4 <4> [526.274202] CPU: 10 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.274205] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.274206] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.274207] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.274212] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.274275] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.274276] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.274278] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.274280] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.274281] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.274282] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.274283] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.274284] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [526.274286] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.274287] CR2: 0000652fc0be1478 CR3: 0000000003448003 CR4: 0000000000f72ef0 <4> [526.274288] PKRU: 55555554 <4> [526.274289] Call Trace: <4> [526.274290] <TASK> <4> [526.274295] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.274300] ? lock_release+0xce/0x280 <4> [526.274305] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.274310] process_one_work+0x22e/0x6b0 <4> [526.274316] worker_thread+0x1e8/0x3d0 <4> [526.274318] ? __pfx_worker_thread+0x10/0x10 <4> [526.274320] kthread+0x11f/0x250 <4> [526.274324] ? __pfx_kthread+0x10/0x10 <4> [526.274327] ret_from_fork+0x344/0x3a0 <4> [526.274329] ? __pfx_kthread+0x10/0x10 <4> [526.274332] ret_from_fork_asm+0x1a/0x30 <4> [526.274339] </TASK> <4> [526.274340] irq event stamp: 913057 <4> [526.274341] hardirqs last enabled at (913063): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.274344] hardirqs last disabled at (913068): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.274346] softirqs last enabled at (912064): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.274349] softirqs last disabled at (912057): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.274351] ---[ end trace 0000000000000000 ]--- <7> [526.274512] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.274632] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.276384] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10773, lrc_seqno=10773, guc_id=0, flags=0x73 in no process [-1] <7> [526.276388] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.276450] ------------[ cut here ]------------ <4> [526.276451] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.276453] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#5: kworker/u64:214/10845 <4> [526.276526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.276584] efi_pstore nfnetlink autofs4 <4> [526.276588] CPU: 5 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.276591] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.276592] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.276593] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.276598] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.276686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.276689] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.276692] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.276694] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.276696] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.276698] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.276700] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.276702] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [526.276704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.276706] CR2: 0000652fc0bde9b8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.276708] PKRU: 55555554 <4> [526.276709] Call Trace: <4> [526.276711] <TASK> <4> [526.276719] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.276727] ? lock_release+0xce/0x280 <4> [526.276736] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.276744] process_one_work+0x22e/0x6b0 <4> [526.276753] worker_thread+0x1e8/0x3d0 <4> [526.276757] ? __pfx_worker_thread+0x10/0x10 <4> [526.276760] kthread+0x11f/0x250 <4> [526.276765] ? __pfx_kthread+0x10/0x10 <4> [526.276770] ret_from_fork+0x344/0x3a0 <4> [526.276772] ? __pfx_kthread+0x10/0x10 <4> [526.276777] ret_from_fork_asm+0x1a/0x30 <4> [526.276785] </TASK> <4> [526.276786] irq event stamp: 675237 <4> [526.276787] hardirqs last enabled at (675243): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.276790] hardirqs last disabled at (675248): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.276792] softirqs last enabled at (675076): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.276794] softirqs last disabled at (675069): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.276796] ---[ end trace 0000000000000000 ]--- <6> [526.276798] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.276864] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.277016] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.277065] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.277279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.277363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.277463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.277565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.277656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.277733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.277810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.277886] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.277976] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.278085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.279092] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.290122] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.290398] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.291744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.291825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.291896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.291965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.292033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.292098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.292165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.292229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.292295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.292360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.292423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.292487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.292551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.292624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.292690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.292756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.292823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.292887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.292951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.293025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.293098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.293168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.293239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.293309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.293378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.293448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.293521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.293592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.293729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.293813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.293890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.293964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.294038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.294111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.294182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.294251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.294317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.294385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.294453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.294524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.294593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.294676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.294744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.294815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.294882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.294948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.295014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.295081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.295145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.295210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.295278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.295344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.295410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.295475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.295542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.295611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.295677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.295746] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.295865] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.296612] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10773, lrc_seqno=10773, guc_id=0, flags=0x73 in no process [-1] <7> [526.296618] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.296721] ------------[ cut here ]------------ <4> [526.296722] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.296723] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.296824] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.296888] efi_pstore nfnetlink autofs4 <4> [526.296892] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.296895] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.296896] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.296898] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [526.296862] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [526.296903] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.296971] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.296972] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.296974] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.296976] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.296977] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.296978] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.296979] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.296980] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.296982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.296983] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.296984] PKRU: 55555554 <4> [526.296985] Call Trace: <4> [526.296986] <TASK> <4> [526.296992] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.296996] ? lock_release+0xce/0x280 <7> [526.296958] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [526.297003] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.297008] process_one_work+0x22e/0x6b0 <4> [526.297013] worker_thread+0x1e8/0x3d0 <4> [526.297016] ? __pfx_worker_thread+0x10/0x10 <4> [526.297018] kthread+0x11f/0x250 <4> [526.297021] ? __pfx_kthread+0x10/0x10 <4> [526.297024] ret_from_fork+0x344/0x3a0 <4> [526.297027] ? __pfx_kthread+0x10/0x10 <4> [526.297029] ret_from_fork_asm+0x1a/0x30 <4> [526.297036] </TASK> <4> [526.297037] irq event stamp: 678333 <4> [526.297038] hardirqs last enabled at (678339): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.297041] hardirqs last disabled at (678344): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.297046] softirqs last enabled at (677258): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.297048] softirqs last disabled at (677249): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.297051] ---[ end trace 0000000000000000 ]--- <6> [526.297053] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.297119] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.297126] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.297396] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.297598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.297696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.297778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.297856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.297933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.298009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.298084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.298158] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.298244] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.298351] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.299402] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.309609] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.309868] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.311194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.311266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.311334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.311402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.311470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.311538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.311612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.311678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.311746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.311813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.311880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.311945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.312011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.312075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.312139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.312205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.312269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.312333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.312397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.312471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.312544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.312619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.312691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.312760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.312827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.312896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.312969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.313040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.313108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.313176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.313245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.313320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.313393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.313465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.313535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.313610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.313676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.313744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.313812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.313882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.313951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.314019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.314087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.314159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.314225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.314292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.314358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.314425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.314491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.314557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.314634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.314701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.314767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.314833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.314900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.314963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.315028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.315096] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.315212] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.316069] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10773, lrc_seqno=10773, guc_id=0, flags=0x73 in no process [-1] <7> [526.316072] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.316130] ------------[ cut here ]------------ <4> [526.316131] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.316133] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#4: kworker/u64:388/11019 <4> [526.316199] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.316261] efi_pstore nfnetlink autofs4 <4> [526.316265] CPU: 4 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.316268] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.316269] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.316270] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.316275] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.316339] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.316340] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.316343] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.316344] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.316345] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.316346] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.316347] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.316349] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [526.316350] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.316351] CR2: 00000006274ecff8 CR3: 000000010808b006 CR4: 0000000000f72ef0 <4> [526.316353] PKRU: 55555554 <4> [526.316354] Call Trace: <4> [526.316355] <TASK> <4> [526.316360] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.316365] ? lock_release+0xce/0x280 <4> [526.316371] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.316376] process_one_work+0x22e/0x6b0 <4> [526.316382] worker_thread+0x1e8/0x3d0 <4> [526.316385] ? __pfx_worker_thread+0x10/0x10 <4> [526.316387] kthread+0x11f/0x250 <4> [526.316390] ? __pfx_kthread+0x10/0x10 <4> [526.316393] ret_from_fork+0x344/0x3a0 <4> [526.316396] ? __pfx_kthread+0x10/0x10 <4> [526.316399] ret_from_fork_asm+0x1a/0x30 <4> [526.316406] </TASK> <4> [526.316407] irq event stamp: 764635 <4> [526.316408] hardirqs last enabled at (764641): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.316411] hardirqs last disabled at (764646): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.316413] softirqs last enabled at (763516): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.316415] softirqs last disabled at (763509): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.316417] ---[ end trace 0000000000000000 ]--- <7> [526.316749] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.316848] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.321680] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10781, lrc_seqno=10781, guc_id=0, flags=0x73 in no process [-1] <7> [526.321683] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.321740] ------------[ cut here ]------------ <4> [526.321741] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.321742] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.321807] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.321864] efi_pstore nfnetlink autofs4 <4> [526.321868] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.321870] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.321871] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.321872] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.321877] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.321939] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.321940] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.321942] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.321944] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.321945] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.321946] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.321947] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.321948] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.321949] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.321950] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.321952] PKRU: 55555554 <4> [526.321953] Call Trace: <4> [526.321954] <TASK> <4> [526.321959] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.321963] ? lock_release+0xce/0x280 <4> [526.321968] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.321973] process_one_work+0x22e/0x6b0 <4> [526.321979] worker_thread+0x1e8/0x3d0 <4> [526.321981] ? __pfx_worker_thread+0x10/0x10 <4> [526.321983] kthread+0x11f/0x250 <4> [526.321986] ? __pfx_kthread+0x10/0x10 <4> [526.321990] ret_from_fork+0x344/0x3a0 <4> [526.321992] ? __pfx_kthread+0x10/0x10 <4> [526.321994] ret_from_fork_asm+0x1a/0x30 <4> [526.322002] </TASK> <4> [526.322003] irq event stamp: 679803 <4> [526.322003] hardirqs last enabled at (679809): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.322006] hardirqs last disabled at (679814): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.322008] softirqs last enabled at (678432): [<ffffffff813346a3>] kernel_fpu_end+0x53/0x70 <4> [526.322010] softirqs last disabled at (678430): [<ffffffff81334d84>] kernel_fpu_begin_mask+0xc4/0x120 <4> [526.322013] ---[ end trace 0000000000000000 ]--- <6> [526.322014] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.322078] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.322083] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.322366] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.322569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.322661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.322747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.322827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.322906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.322983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.323060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.323133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.323222] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.323330] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.324338] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.334608] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.334866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.336150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.336223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.336293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.336363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.336430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.336497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.336564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.336639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.336707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.336773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.336840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.336905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.336968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.337032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.337096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.337160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.337224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.337289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.337354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.337427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.337500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.337572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.337667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.337748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.337824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.337893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.337965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.338033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.338101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.338170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.338239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.338314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.338388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.338463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.338536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.338611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.338679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.338746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.338812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.338883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.338951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.339021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.339088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.339157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.339222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.339290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.339358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.339427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.339493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.339558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.339632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.339699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.339766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.339832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.339899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.339965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.340031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.340099] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.340212] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.341063] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10781, lrc_seqno=10781, guc_id=0, flags=0x73 in no process [-1] <7> [526.341066] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.341122] ------------[ cut here ]------------ <4> [526.341123] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.341124] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#4: kworker/u64:388/11019 <4> [526.341191] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.341248] efi_pstore nfnetlink autofs4 <4> [526.341252] CPU: 4 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.341255] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.341256] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.341257] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.341262] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.341327] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.341328] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.341330] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.341331] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.341333] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.341334] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.341335] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.341336] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [526.341337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.341338] CR2: 00000006274ecff8 CR3: 000000010808b006 CR4: 0000000000f72ef0 <4> [526.341340] PKRU: 55555554 <4> [526.341341] Call Trace: <4> [526.341342] <TASK> <4> [526.341347] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.341352] ? lock_release+0xce/0x280 <4> [526.341357] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.341362] process_one_work+0x22e/0x6b0 <4> [526.341368] worker_thread+0x1e8/0x3d0 <4> [526.341370] ? __pfx_worker_thread+0x10/0x10 <4> [526.341373] kthread+0x11f/0x250 <4> [526.341376] ? __pfx_kthread+0x10/0x10 <4> [526.341379] ret_from_fork+0x344/0x3a0 <4> [526.341381] ? __pfx_kthread+0x10/0x10 <4> [526.341384] ret_from_fork_asm+0x1a/0x30 <4> [526.341391] </TASK> <4> [526.341392] irq event stamp: 768201 <4> [526.341393] hardirqs last enabled at (768207): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.341396] hardirqs last disabled at (768212): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.341398] softirqs last enabled at (767192): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.341400] softirqs last disabled at (767183): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.341403] ---[ end trace 0000000000000000 ]--- <6> [526.341404] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.341467] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.341473] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.341485] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.341579] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.341762] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.341970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.342059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.342146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.342225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.342302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.342378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.342455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.342528] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.342621] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.342734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.343742] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.353610] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.353868] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.355160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.355231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.355301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.355370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.355438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.355506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.355575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.355662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.355730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.355795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.355860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.355925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.355990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.356057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.356122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.356187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.356250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.356313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.356378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.356451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.356524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.356593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.356682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.356753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.356821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.356892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.356965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.357034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.357101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.357168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.357235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.357310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.357382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.357456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.357528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.357596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.357682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.357748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.357813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.357884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.357951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.358017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.358083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.358150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.358214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.358281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.358345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.358411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.358478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.358546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.358619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.358684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.358753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.358818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.358883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.358949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.359012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.359078] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.359199] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.360052] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10781, lrc_seqno=10781, guc_id=0, flags=0x73 in no process [-1] <7> [526.360055] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.360111] ------------[ cut here ]------------ <4> [526.360112] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.360113] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:391/11022 <4> [526.360180] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.360238] efi_pstore nfnetlink autofs4 <4> [526.360242] CPU: 3 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.360245] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.360246] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.360247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.360252] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.360317] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.360318] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.360320] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.360322] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.360323] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.360324] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.360325] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.360326] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.360328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.360329] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.360330] PKRU: 55555554 <4> [526.360331] Call Trace: <4> [526.360332] <TASK> <4> [526.360338] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.360342] ? lock_release+0xce/0x280 <4> [526.360348] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.360352] process_one_work+0x22e/0x6b0 <4> [526.360358] worker_thread+0x1e8/0x3d0 <4> [526.360361] ? __pfx_worker_thread+0x10/0x10 <4> [526.360363] kthread+0x11f/0x250 <4> [526.360366] ? __pfx_kthread+0x10/0x10 <4> [526.360370] ret_from_fork+0x344/0x3a0 <4> [526.360372] ? __pfx_kthread+0x10/0x10 <4> [526.360374] ret_from_fork_asm+0x1a/0x30 <4> [526.360382] </TASK> <4> [526.360383] irq event stamp: 916835 <4> [526.360384] hardirqs last enabled at (916841): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.360386] hardirqs last disabled at (916846): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.360388] softirqs last enabled at (915722): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.360391] softirqs last disabled at (915713): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.360393] ---[ end trace 0000000000000000 ]--- <7> [526.360655] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.360810] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.362829] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10782, lrc_seqno=10782, guc_id=0, flags=0x73 in no process [-1] <7> [526.362835] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.362956] ------------[ cut here ]------------ <4> [526.362958] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.362960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:391/11022 <4> [526.363066] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath <7> [526.363163] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:557] <4> [526.363167] msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [526.363177] CPU: 3 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.363182] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.363184] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.363186] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.363193] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.363297] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.363300] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.363304] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.363306] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.363308] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.363311] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.363313] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.363315] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.363317] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.363320] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.363322] PKRU: 55555554 <4> [526.363324] Call Trace: <4> [526.363326] <TASK> <4> [526.363335] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.363343] ? lock_release+0xce/0x280 <4> [526.363352] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.363360] process_one_work+0x22e/0x6b0 <4> [526.363371] worker_thread+0x1e8/0x3d0 <4> [526.363375] ? __pfx_worker_thread+0x10/0x10 <4> [526.363379] kthread+0x11f/0x250 <4> [526.363384] ? __pfx_kthread+0x10/0x10 <4> [526.363390] ret_from_fork+0x344/0x3a0 <4> [526.363393] ? __pfx_kthread+0x10/0x10 <4> [526.363397] ret_from_fork_asm+0x1a/0x30 <4> [526.363410] </TASK> <4> [526.363412] irq event stamp: 917755 <4> [526.363414] hardirqs last enabled at (917761): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.363418] hardirqs last disabled at (917766): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.363421] softirqs last enabled at (915722): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.363425] softirqs last disabled at (915713): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.363429] ---[ end trace 0000000000000000 ]--- <6> [526.363431] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.363534] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.363590] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.363646] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.363884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.363979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.364105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.364197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.364277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.364368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.364490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.364590] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.364725] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.364835] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.365915] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.376618] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.376877] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.378199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.378272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.378341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.378408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.378476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.378541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.378613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.378677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.378741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.378807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.378872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.378936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.378999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.379064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.379128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.379193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.379256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.379321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.379386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.379459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.379531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.379605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.379677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.379745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.379811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.379881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.379951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.380021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.380088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.380158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.380225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.380299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.380372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.380445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.380514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.380581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.380663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.380732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.380798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.380865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.380931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.380997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.381062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.381130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.381196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.381262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.381326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.381394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.381458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.381523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.381591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.381673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.381739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.381805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.381872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.381937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.382002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.382072] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.382190] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.383048] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10782, lrc_seqno=10782, guc_id=0, flags=0x73 in no process [-1] <7> [526.383051] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.383107] ------------[ cut here ]------------ <4> [526.383108] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.383110] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:391/11022 <4> [526.383189] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.383247] efi_pstore nfnetlink autofs4 <4> [526.383251] CPU: 3 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.383254] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.383255] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.383256] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.383261] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.383326] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.383328] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.383330] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.383331] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.383332] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.383333] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.383334] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.383336] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.383337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.383338] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.383340] PKRU: 55555554 <4> [526.383341] Call Trace: <4> [526.383342] <TASK> <4> [526.383347] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.383351] ? lock_release+0xce/0x280 <4> [526.383357] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.383362] process_one_work+0x22e/0x6b0 <4> [526.383367] worker_thread+0x1e8/0x3d0 <4> [526.383370] ? __pfx_worker_thread+0x10/0x10 <4> [526.383372] kthread+0x11f/0x250 <4> [526.383375] ? __pfx_kthread+0x10/0x10 <4> [526.383378] ret_from_fork+0x344/0x3a0 <4> [526.383380] ? __pfx_kthread+0x10/0x10 <4> [526.383383] ret_from_fork_asm+0x1a/0x30 <4> [526.383391] </TASK> <4> [526.383392] irq event stamp: 920831 <4> [526.383393] hardirqs last enabled at (920837): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.383395] hardirqs last disabled at (920842): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.383397] softirqs last enabled at (919934): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.383400] softirqs last disabled at (919927): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.383402] ---[ end trace 0000000000000000 ]--- <6> [526.383403] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.383470] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.383476] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.383751] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.383848] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.383947] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.384147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.384226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.384308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.384385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.384460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.384536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.384617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.384692] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.384781] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.384891] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.385896] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.396607] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.396867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.398180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.398252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.398320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.398389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.398457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.398525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.398592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.398678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.398744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.398809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.398873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.398939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.399004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.399071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.399136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.399200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.399266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.399331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.399396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.399470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.399542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.399617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.399689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.399758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.399824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.399894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.399967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.400036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.400106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.400174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.400241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.400317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.400391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.400464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.400534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.400613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.400681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.400747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.400812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.400879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.400946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.401013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.401078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.401147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.401212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.401279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.401346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.401412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.401476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.401539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.401612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.401679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.401746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.401811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.401877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.401942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.402005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.402071] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.402191] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.403046] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10782, lrc_seqno=10782, guc_id=0, flags=0x73 in no process [-1] <7> [526.403049] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.403114] ------------[ cut here ]------------ <4> [526.403116] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.403117] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:391/11022 <4> [526.403193] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.403259] efi_pstore nfnetlink autofs4 <4> [526.403263] CPU: 3 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.403265] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.403267] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.403268] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.403273] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.403337] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.403339] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.403341] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.403342] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.403343] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.403344] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.403345] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.403346] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.403348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.403349] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.403350] PKRU: 55555554 <4> [526.403351] Call Trace: <4> [526.403352] <TASK> <4> [526.403358] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.403362] ? lock_release+0xce/0x280 <4> [526.403368] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.403372] process_one_work+0x22e/0x6b0 <4> [526.403378] worker_thread+0x1e8/0x3d0 <4> [526.403381] ? __pfx_worker_thread+0x10/0x10 <4> [526.403383] kthread+0x11f/0x250 <4> [526.403386] ? __pfx_kthread+0x10/0x10 <4> [526.403389] ret_from_fork+0x344/0x3a0 <4> [526.403391] ? __pfx_kthread+0x10/0x10 <4> [526.403394] ret_from_fork_asm+0x1a/0x30 <4> [526.403401] </TASK> <4> [526.403402] irq event stamp: 923941 <4> [526.403403] hardirqs last enabled at (923947): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.403406] hardirqs last disabled at (923952): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.403408] softirqs last enabled at (922822): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.403410] softirqs last disabled at (922815): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.403412] ---[ end trace 0000000000000000 ]--- <7> [526.403914] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.404053] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.409904] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10798, lrc_seqno=10798, guc_id=0, flags=0x73 in no process [-1] <7> [526.409907] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.409968] ------------[ cut here ]------------ <4> [526.409969] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.409970] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.410040] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.410098] efi_pstore nfnetlink autofs4 <4> [526.410102] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.410105] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.410106] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.410107] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.410112] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.410178] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.410179] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.410181] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.410182] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.410183] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.410184] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.410185] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.410187] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.410188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.410189] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.410191] PKRU: 55555554 <4> [526.410192] Call Trace: <4> [526.410193] <TASK> <4> [526.410198] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.410202] ? lock_release+0xce/0x280 <4> [526.410208] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.410212] process_one_work+0x22e/0x6b0 <4> [526.410218] worker_thread+0x1e8/0x3d0 <4> [526.410221] ? __pfx_worker_thread+0x10/0x10 <4> [526.410223] kthread+0x11f/0x250 <4> [526.410226] ? __pfx_kthread+0x10/0x10 <4> [526.410229] ret_from_fork+0x344/0x3a0 <4> [526.410231] ? __pfx_kthread+0x10/0x10 <4> [526.410234] ret_from_fork_asm+0x1a/0x30 <4> [526.410242] </TASK> <4> [526.410243] irq event stamp: 682377 <4> [526.410244] hardirqs last enabled at (682383): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.410246] hardirqs last disabled at (682388): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.410249] softirqs last enabled at (681542): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.410251] softirqs last disabled at (681535): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.410253] ---[ end trace 0000000000000000 ]--- <6> [526.410255] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.410319] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.410325] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.410611] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.410818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.410905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.410992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.411074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.411152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.411229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.411307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.411382] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.411472] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.411583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.412606] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.423323] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.423579] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.424835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.424905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.424968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.425031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.425093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.425154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.425214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.425273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.425332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.425390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.425448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.425506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.425564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.425640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.425701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.425761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.425821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.425880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.425938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.426004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.426071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.426134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.426198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.426259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.426320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.426383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.426450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.426514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.426576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.426650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.426713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.426782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.426850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.426917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.426982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.427045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.427106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.427167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.427228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.427292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.427355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.427418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.427478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.427542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.427606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.427671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.427736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.427798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.427858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.427916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.427977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.428036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.428096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.428157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.428218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.428276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.428335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.428397] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.428505] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.429357] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10798, lrc_seqno=10798, guc_id=0, flags=0x73 in no process [-1] <7> [526.429359] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.429411] ------------[ cut here ]------------ <4> [526.429412] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.429413] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:391/11022 <4> [526.429477] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.429536] efi_pstore nfnetlink autofs4 <4> [526.429540] CPU: 3 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.429543] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.429544] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.429546] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.429550] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.429626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.429628] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.429630] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.429631] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.429633] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.429634] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.429635] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.429636] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.429638] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.429639] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.429640] PKRU: 55555554 <4> [526.429641] Call Trace: <4> [526.429642] <TASK> <4> [526.429648] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.429653] ? lock_release+0xce/0x280 <4> [526.429658] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.429663] process_one_work+0x22e/0x6b0 <4> [526.429669] worker_thread+0x1e8/0x3d0 <4> [526.429672] ? __pfx_worker_thread+0x10/0x10 <4> [526.429674] kthread+0x11f/0x250 <4> [526.429678] ? __pfx_kthread+0x10/0x10 <4> [526.429681] ret_from_fork+0x344/0x3a0 <4> [526.429683] ? __pfx_kthread+0x10/0x10 <4> [526.429686] ret_from_fork_asm+0x1a/0x30 <4> [526.429693] </TASK> <4> [526.429695] irq event stamp: 927397 <4> [526.429696] hardirqs last enabled at (927403): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.429700] hardirqs last disabled at (927408): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.429701] softirqs last enabled at (927236): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.429704] softirqs last disabled at (927231): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.429706] ---[ end trace 0000000000000000 ]--- <6> [526.429708] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.429769] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.429774] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.430046] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.430150] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.430255] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.430448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.430523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.430607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.430687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.430760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.430830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.430899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.430965] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.431045] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.431146] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.432139] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.442607] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.442863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.444222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.444289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.444352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.444415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.444478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.444538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.444606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.444671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.444735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.444801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.444866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.444930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.444994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.445059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.445123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.445187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.445251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.445315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.445379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.445452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.445525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.445594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.445683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.445752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.445818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.445887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.445958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.446027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.446094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.446163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.446231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.446304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.446378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.446450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.446519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.446587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.446666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.446734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.446800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.446868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.446934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.447002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.447066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.447135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.447199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.447265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.447334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.447403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.447468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.447533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.447604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.447672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.447739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.447803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.447870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.447934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.448000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.448066] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.448185] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.449034] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10798, lrc_seqno=10798, guc_id=0, flags=0x73 in no process [-1] <7> [526.449037] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.449094] ------------[ cut here ]------------ <4> [526.449095] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.449097] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:391/11022 <4> [526.449162] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.449220] efi_pstore nfnetlink autofs4 <4> [526.449224] CPU: 3 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.449227] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.449228] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.449229] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.449234] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.449299] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.449301] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.449303] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.449304] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.449305] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.449306] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.449307] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.449308] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.449310] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.449311] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.449312] PKRU: 55555554 <4> [526.449313] Call Trace: <4> [526.449314] <TASK> <4> [526.449319] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.449324] ? lock_release+0xce/0x280 <4> [526.449330] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.449335] process_one_work+0x22e/0x6b0 <4> [526.449340] worker_thread+0x1e8/0x3d0 <4> [526.449343] ? __pfx_worker_thread+0x10/0x10 <4> [526.449345] kthread+0x11f/0x250 <4> [526.449348] ? __pfx_kthread+0x10/0x10 <4> [526.449351] ret_from_fork+0x344/0x3a0 <4> [526.449353] ? __pfx_kthread+0x10/0x10 <4> [526.449356] ret_from_fork_asm+0x1a/0x30 <4> [526.449363] </TASK> <4> [526.449364] irq event stamp: 930513 <4> [526.449365] hardirqs last enabled at (930519): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.449368] hardirqs last disabled at (930524): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.449370] softirqs last enabled at (929512): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.449373] softirqs last disabled at (929505): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.449375] ---[ end trace 0000000000000000 ]--- <7> [526.449624] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.449754] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.451688] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10799, lrc_seqno=10799, guc_id=0, flags=0x73 in no process [-1] <7> [526.451690] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.451748] ------------[ cut here ]------------ <4> [526.451749] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.451750] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.451813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.451870] efi_pstore nfnetlink autofs4 <4> [526.451874] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.451876] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.451877] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.451878] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.451883] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.451947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.451949] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.451950] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.451952] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.451953] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.451954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.451955] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.451956] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.451957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.451958] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.451960] PKRU: 55555554 <4> [526.451961] Call Trace: <4> [526.451962] <TASK> <4> [526.451967] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.451971] ? lock_release+0xce/0x280 <4> [526.451976] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.451981] process_one_work+0x22e/0x6b0 <4> [526.451987] worker_thread+0x1e8/0x3d0 <4> [526.451990] ? __pfx_worker_thread+0x10/0x10 <4> [526.451992] kthread+0x11f/0x250 <4> [526.451995] ? __pfx_kthread+0x10/0x10 <4> [526.451998] ret_from_fork+0x344/0x3a0 <4> [526.452000] ? __pfx_kthread+0x10/0x10 <4> [526.452003] ret_from_fork_asm+0x1a/0x30 <4> [526.452010] </TASK> <4> [526.452011] irq event stamp: 683753 <4> [526.452012] hardirqs last enabled at (683759): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.452014] hardirqs last disabled at (683764): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.452016] softirqs last enabled at (682844): [<ffffffff813346a3>] kernel_fpu_end+0x53/0x70 <4> [526.452019] softirqs last disabled at (682842): [<ffffffff81334d84>] kernel_fpu_begin_mask+0xc4/0x120 <4> [526.452021] ---[ end trace 0000000000000000 ]--- <6> [526.452023] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.452085] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.452092] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.452151] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.452360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.452477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.452605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.452755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.452860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.452940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.453065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.453179] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.453286] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.453398] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.454409] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.464606] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.464865] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.466191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.466257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.466319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.466383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.466444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.466506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.466566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.466642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.466709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.466776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.466841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.466906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.466971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.467036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.467101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.467164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.467228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.467292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.467356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.467429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.467500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.467570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.467653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.467723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.467791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.467860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.467932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.468003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.468071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.468139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.468209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.468284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.468362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.468438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.468509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.468579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.468657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.468724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.468789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.468859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.468925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.468994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.469059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.469129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.469195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.469261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.469327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.469394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.469458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.469523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.469592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.469675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.469742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.469807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.469873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.469938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.470003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.470073] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.470191] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.470626] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10799, lrc_seqno=10799, guc_id=0, flags=0x73 in no process [-1] <7> [526.470635] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.470983] ------------[ cut here ]------------ <4> [526.470986] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.470990] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#2: kworker/u64:391/11022 <4> [526.471092] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.471151] efi_pstore nfnetlink autofs4 <4> [526.471155] CPU: 2 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.471159] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.471161] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.471163] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.471171] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <7> [526.471173] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [526.471282] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.471285] RSP: 0000:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.471288] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.471290] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.471292] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.471294] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.471295] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.471297] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [526.471300] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.471301] CR2: 000078650ffa9000 CR3: 0000000165c07004 CR4: 0000000000f72ef0 <4> [526.471303] PKRU: 55555554 <4> [526.471305] Call Trace: <4> [526.471306] <TASK> <4> [526.471316] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.471324] ? lock_release+0xce/0x280 <4> [526.471332] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.471340] process_one_work+0x22e/0x6b0 <4> [526.471348] worker_thread+0x1e8/0x3d0 <4> [526.471353] ? __pfx_worker_thread+0x10/0x10 <4> [526.471356] kthread+0x11f/0x250 <4> [526.471361] ? __pfx_kthread+0x10/0x10 <4> [526.471367] ret_from_fork+0x344/0x3a0 <4> [526.471370] ? __pfx_kthread+0x10/0x10 <4> [526.471374] ret_from_fork_asm+0x1a/0x30 <7> [526.471319] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [526.471387] </TASK> <4> [526.471388] irq event stamp: 933739 <4> [526.471390] hardirqs last enabled at (933745): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.471393] hardirqs last disabled at (933750): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.471396] softirqs last enabled at (932626): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.471399] softirqs last disabled at (932619): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.471401] ---[ end trace 0000000000000000 ]--- <6> [526.471404] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.471492] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.471499] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.471771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.471971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.472055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.472144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.472226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.472305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.472383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.472461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.472535] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.472630] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.472741] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.473748] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.483606] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.483865] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.485155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.485229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.485298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.485366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.485432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.485498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.485563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.485640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.485706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.485770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.485835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.485898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.485965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.486030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.486093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.486158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.486222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.486286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.486350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.486424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.486496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.486564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.486642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.486710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.486775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.486843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.486916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.486985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.487054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.487122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.487189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.487263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.487336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.487409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.487479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.487548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.487618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.487686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.487752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.487821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.487890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.487959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.488025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.488094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.488161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.488227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.488291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.488357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.488421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.488484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.488550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.488619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.488685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.488749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.488815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.488879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.488942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.489011] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.489125] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.489976] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10799, lrc_seqno=10799, guc_id=0, flags=0x73 in no process [-1] <7> [526.489978] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.490065] ------------[ cut here ]------------ <4> [526.490066] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.490067] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.490134] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.490192] efi_pstore nfnetlink autofs4 <4> [526.490197] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.490200] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.490201] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.490203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.490208] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.490273] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.490274] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.490277] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.490278] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.490279] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.490281] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.490282] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.490284] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.490285] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.490286] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.490288] PKRU: 55555554 <4> [526.490289] Call Trace: <4> [526.490290] <TASK> <4> [526.490295] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.490301] ? lock_release+0xce/0x280 <4> [526.490306] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.490311] process_one_work+0x22e/0x6b0 <4> [526.490317] worker_thread+0x1e8/0x3d0 <4> [526.490320] ? __pfx_worker_thread+0x10/0x10 <4> [526.490322] kthread+0x11f/0x250 <4> [526.490326] ? __pfx_kthread+0x10/0x10 <4> [526.490329] ret_from_fork+0x344/0x3a0 <4> [526.490331] ? __pfx_kthread+0x10/0x10 <4> [526.490334] ret_from_fork_asm+0x1a/0x30 <4> [526.490342] </TASK> <4> [526.490343] irq event stamp: 687261 <4> [526.490344] hardirqs last enabled at (687267): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.490347] hardirqs last disabled at (687272): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.490350] softirqs last enabled at (686258): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.490352] softirqs last disabled at (686253): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.490354] ---[ end trace 0000000000000000 ]--- <7> [526.490460] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.490559] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.495320] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10807, lrc_seqno=10807, guc_id=0, flags=0x73 in no process [-1] <7> [526.495323] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.495381] ------------[ cut here ]------------ <4> [526.495382] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.495383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.495449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.495506] efi_pstore nfnetlink autofs4 <4> [526.495510] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.495512] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.495513] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.495514] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.495519] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.495583] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.495585] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.495587] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.495588] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.495589] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.495590] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.495591] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.495592] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.495593] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.495595] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.495600] PKRU: 55555554 <4> [526.495601] Call Trace: <4> [526.495602] <TASK> <4> [526.495607] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.495612] ? lock_release+0xce/0x280 <4> [526.495617] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.495622] process_one_work+0x22e/0x6b0 <4> [526.495627] worker_thread+0x1e8/0x3d0 <4> [526.495630] ? __pfx_worker_thread+0x10/0x10 <4> [526.495632] kthread+0x11f/0x250 <4> [526.495635] ? __pfx_kthread+0x10/0x10 <4> [526.495639] ret_from_fork+0x344/0x3a0 <4> [526.495641] ? __pfx_kthread+0x10/0x10 <4> [526.495644] ret_from_fork_asm+0x1a/0x30 <4> [526.495651] </TASK> <4> [526.495652] irq event stamp: 688389 <4> [526.495653] hardirqs last enabled at (688395): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.495656] hardirqs last disabled at (688400): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.495658] softirqs last enabled at (688298): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.495660] softirqs last disabled at (688293): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.495663] ---[ end trace 0000000000000000 ]--- <6> [526.495664] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.495728] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.495733] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.496014] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.496213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.496294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.496388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.496468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.496546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.496627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.496706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.496779] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.496867] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.496975] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.497992] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.508605] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.508860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.510154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.510228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.510298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.510367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.510435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.510502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.510568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.510645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.510711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.510777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.510843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.510909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.510974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.511039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.511104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.511171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.511236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.511301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.511365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.511440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.511514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.511585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.511669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.511739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.511808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.511879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.511952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.512022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.512091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.512160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.512228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.512301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.512375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.512453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.512525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.512593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.512675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.512742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.512808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.512879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.512945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.513011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.513076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.513148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.513214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.513281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.513346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.513414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.513478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.513542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.513613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.513679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.513744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.513808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.513873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.513937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.514002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.514070] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.514190] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.515047] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10807, lrc_seqno=10807, guc_id=0, flags=0x73 in no process [-1] <7> [526.515049] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.515137] ------------[ cut here ]------------ <4> [526.515138] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.515139] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.515205] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.515262] efi_pstore nfnetlink autofs4 <4> [526.515266] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.515269] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.515270] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.515271] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.515276] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.515340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.515341] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.515343] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.515344] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.515345] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.515347] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.515348] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.515349] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.515350] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.515351] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.515353] PKRU: 55555554 <4> [526.515354] Call Trace: <4> [526.515355] <TASK> <4> [526.515360] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.515364] ? lock_release+0xce/0x280 <4> [526.515370] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.515375] process_one_work+0x22e/0x6b0 <4> [526.515380] worker_thread+0x1e8/0x3d0 <4> [526.515383] ? __pfx_worker_thread+0x10/0x10 <4> [526.515385] kthread+0x11f/0x250 <4> [526.515388] ? __pfx_kthread+0x10/0x10 <4> [526.515391] ret_from_fork+0x344/0x3a0 <4> [526.515393] ? __pfx_kthread+0x10/0x10 <4> [526.515396] ret_from_fork_asm+0x1a/0x30 <4> [526.515403] </TASK> <4> [526.515404] irq event stamp: 691475 <4> [526.515405] hardirqs last enabled at (691481): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.515408] hardirqs last disabled at (691486): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.515410] softirqs last enabled at (690472): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.515412] softirqs last disabled at (690467): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.515414] ---[ end trace 0000000000000000 ]--- <6> [526.515416] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.515481] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.515486] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.515759] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.515854] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.515951] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.516150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.516230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.516312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.516391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.516466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.516542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.516621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.516694] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.516781] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.516889] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.517892] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.528603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.528862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.530183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.530256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.530325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.530395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.530463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.530533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.530606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.530675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.530742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.530809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.530874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.530939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.531006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.531075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.531141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.531206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.531273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.531338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.531405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.531479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.531552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.531629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.531700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.531770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.531838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.531907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.531979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.532049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.532118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.532188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.532256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.532330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.532403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.532477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.532549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.532624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.532693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.532758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.532822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.532891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.532957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.533023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.533089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.533157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.533223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.533289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.533354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.533420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.533485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.533550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.533624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.533692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.533757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.533822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.533892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.533959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.534025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.534094] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.534209] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.535061] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10807, lrc_seqno=10807, guc_id=0, flags=0x73 in no process [-1] <7> [526.535063] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.535149] ------------[ cut here ]------------ <4> [526.535150] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.535151] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.535217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.535275] efi_pstore nfnetlink autofs4 <4> [526.535279] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.535281] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.535282] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.535283] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.535288] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.535352] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.535353] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.535355] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.535357] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.535358] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.535359] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.535360] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.535361] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.535362] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.535364] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.535365] PKRU: 55555554 <4> [526.535366] Call Trace: <4> [526.535367] <TASK> <4> [526.535372] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.535376] ? lock_release+0xce/0x280 <4> [526.535382] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.535387] process_one_work+0x22e/0x6b0 <4> [526.535392] worker_thread+0x1e8/0x3d0 <4> [526.535395] ? __pfx_worker_thread+0x10/0x10 <4> [526.535397] kthread+0x11f/0x250 <4> [526.535400] ? __pfx_kthread+0x10/0x10 <4> [526.535403] ret_from_fork+0x344/0x3a0 <4> [526.535405] ? __pfx_kthread+0x10/0x10 <4> [526.535408] ret_from_fork_asm+0x1a/0x30 <4> [526.535415] </TASK> <4> [526.535416] irq event stamp: 694599 <4> [526.535417] hardirqs last enabled at (694605): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.535420] hardirqs last disabled at (694610): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.535422] softirqs last enabled at (693692): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.535424] softirqs last disabled at (693687): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.535427] ---[ end trace 0000000000000000 ]--- <7> [526.535583] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.535687] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.537669] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10808, lrc_seqno=10808, guc_id=0, flags=0x73 in no process [-1] <7> [526.537673] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.537736] ------------[ cut here ]------------ <4> [526.537737] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.537739] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#1: kworker/u64:390/11021 <4> [526.537810] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec <7> [526.537820] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558] <4> [526.537825] rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [526.537875] CPU: 1 UID: 0 PID: 11021 Comm: kworker/u64:390 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.537878] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.537879] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.537881] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.537885] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.537953] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.537954] RSP: 0018:ffffc90022d8fc98 EFLAGS: 00010246 <4> [526.537957] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.537958] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.537959] RBP: ffffc90022d8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.537960] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.537961] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.537962] FS: 0000000000000000(0000) GS:ffff8888dad5d000(0000) knlGS:0000000000000000 <4> [526.537964] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.537965] CR2: 00007bffbc70a368 CR3: 0000000003448002 CR4: 0000000000f72ef0 <4> [526.537966] PKRU: 55555554 <4> [526.537967] Call Trace: <4> [526.537968] <TASK> <4> [526.537974] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.537978] ? lock_release+0xce/0x280 <4> [526.537984] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.537989] process_one_work+0x22e/0x6b0 <4> [526.537994] worker_thread+0x1e8/0x3d0 <4> [526.537997] ? __pfx_worker_thread+0x10/0x10 <4> [526.537999] kthread+0x11f/0x250 <4> [526.538002] ? __pfx_kthread+0x10/0x10 <4> [526.538005] ret_from_fork+0x344/0x3a0 <4> [526.538007] ? __pfx_kthread+0x10/0x10 <4> [526.538010] ret_from_fork_asm+0x1a/0x30 <4> [526.538018] </TASK> <4> [526.538018] irq event stamp: 899605 <4> [526.538019] hardirqs last enabled at (899611): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.538022] hardirqs last disabled at (899616): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.538024] softirqs last enabled at (898696): [<ffffffff813346a3>] kernel_fpu_end+0x53/0x70 <4> [526.538026] softirqs last disabled at (898694): [<ffffffff81334d84>] kernel_fpu_begin_mask+0xc4/0x120 <4> [526.538029] ---[ end trace 0000000000000000 ]--- <6> [526.538031] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.538097] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.538103] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.538188] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.538398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.538492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.538585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.538684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.538769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.538849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.538930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.539007] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.539102] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.539215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.540224] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.550603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.550867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.552134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.552212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.552286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.552358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.552430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.552501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.552573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.552653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.552725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.552795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.552864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.552933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.553001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.553070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.553139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.553208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.553275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.553344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.553412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.553489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.553566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.553655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.553733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.553803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.553875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.553952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.554029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.554104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.554173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.554244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.554314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.554390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.554466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.554544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.554620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.554693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.554762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.554831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.554899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.554971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.555041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.555111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.555181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.555255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.555323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.555392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.555460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.555531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.555604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.555674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.555750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.555821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.555890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.555958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.556029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.556096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.556164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.556235] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.556353] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.557206] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10808, lrc_seqno=10808, guc_id=0, flags=0x73 in no process [-1] <7> [526.557208] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.557270] ------------[ cut here ]------------ <4> [526.557271] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.557272] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#4: kworker/u64:388/11019 <4> [526.557343] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.557402] efi_pstore nfnetlink autofs4 <4> [526.557406] CPU: 4 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.557409] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.557410] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.557411] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.557416] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.557484] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.557486] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.557488] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.557489] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.557490] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.557491] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.557492] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.557493] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [526.557495] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.557496] CR2: 00000006274ecff8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.557498] PKRU: 55555554 <4> [526.557499] Call Trace: <4> [526.557500] <TASK> <4> [526.557505] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.557510] ? lock_release+0xce/0x280 <4> [526.557515] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.557520] process_one_work+0x22e/0x6b0 <4> [526.557526] worker_thread+0x1e8/0x3d0 <4> [526.557529] ? __pfx_worker_thread+0x10/0x10 <4> [526.557531] kthread+0x11f/0x250 <4> [526.557534] ? __pfx_kthread+0x10/0x10 <4> [526.557537] ret_from_fork+0x344/0x3a0 <4> [526.557539] ? __pfx_kthread+0x10/0x10 <4> [526.557542] ret_from_fork_asm+0x1a/0x30 <4> [526.557550] </TASK> <4> [526.557551] irq event stamp: 772151 <4> [526.557552] hardirqs last enabled at (772157): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.557554] hardirqs last disabled at (772162): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.557556] softirqs last enabled at (771234): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.557559] softirqs last disabled at (771229): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.557561] ---[ end trace 0000000000000000 ]--- <6> [526.557563] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.557641] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.557646] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.557929] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.558030] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.558135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.558338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.558423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.558509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.558589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.558682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.558759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.558837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.558914] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.559005] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.559117] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.560126] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.570604] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.570866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.572185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.572256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.572325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.572394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.572461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.572528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.572599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.572664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.572731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.572798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.572864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.572930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.572995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.573060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.573127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.573192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.573257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.573321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.573385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.573458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.573531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.573603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.573673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.573741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.573808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.573876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.573945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.574013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.574080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.574147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.574214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.574285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.574358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.574429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.574497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.574566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.574643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.574709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.574773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.574839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.574905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.574969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.575034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.575102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.575167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.575232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.575298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.575364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.575427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.575492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.575558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.575631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.575696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.575760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.575826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.575889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.575952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.576019] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.576134] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.576981] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10808, lrc_seqno=10808, guc_id=0, flags=0x73 in no process [-1] <7> [526.576984] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.577041] ------------[ cut here ]------------ <4> [526.577042] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.577043] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#4: kworker/u64:388/11019 <4> [526.577110] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.577167] efi_pstore nfnetlink autofs4 <4> [526.577171] CPU: 4 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.577174] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.577175] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.577177] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.577182] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.577246] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.577247] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.577249] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.577251] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.577252] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.577253] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.577254] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.577255] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [526.577257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.577258] CR2: 00000006274ecff8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.577259] PKRU: 55555554 <4> [526.577260] Call Trace: <4> [526.577261] <TASK> <4> [526.577266] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.577271] ? lock_release+0xce/0x280 <4> [526.577276] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.577281] process_one_work+0x22e/0x6b0 <4> [526.577287] worker_thread+0x1e8/0x3d0 <4> [526.577289] ? __pfx_worker_thread+0x10/0x10 <4> [526.577292] kthread+0x11f/0x250 <4> [526.577295] ? __pfx_kthread+0x10/0x10 <4> [526.577298] ret_from_fork+0x344/0x3a0 <4> [526.577300] ? __pfx_kthread+0x10/0x10 <4> [526.577303] ret_from_fork_asm+0x1a/0x30 <4> [526.577310] </TASK> <4> [526.577311] irq event stamp: 775265 <4> [526.577312] hardirqs last enabled at (775271): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.577315] hardirqs last disabled at (775276): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.577317] softirqs last enabled at (774368): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.577320] softirqs last disabled at (774361): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.577322] ---[ end trace 0000000000000000 ]--- <7> [526.577702] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.577800] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.583290] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10824, lrc_seqno=10824, guc_id=0, flags=0x73 in no process [-1] <7> [526.583293] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.583352] ------------[ cut here ]------------ <4> [526.583353] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.583354] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.583424] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.583481] efi_pstore nfnetlink autofs4 <4> [526.583485] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.583488] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.583489] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.583491] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.583496] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.583561] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.583562] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.583564] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.583565] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.583567] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.583568] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.583569] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.583570] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.583571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.583572] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.583574] PKRU: 55555554 <4> [526.583575] Call Trace: <4> [526.583576] <TASK> <4> [526.583581] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.583586] ? lock_release+0xce/0x280 <4> [526.583591] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.583601] process_one_work+0x22e/0x6b0 <4> [526.583607] worker_thread+0x1e8/0x3d0 <4> [526.583610] ? __pfx_worker_thread+0x10/0x10 <4> [526.583612] kthread+0x11f/0x250 <4> [526.583615] ? __pfx_kthread+0x10/0x10 <4> [526.583619] ret_from_fork+0x344/0x3a0 <4> [526.583621] ? __pfx_kthread+0x10/0x10 <4> [526.583624] ret_from_fork_asm+0x1a/0x30 <4> [526.583631] </TASK> <4> [526.583632] irq event stamp: 696177 <4> [526.583633] hardirqs last enabled at (696183): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.583636] hardirqs last disabled at (696188): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.583638] softirqs last enabled at (696122): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.583641] softirqs last disabled at (696113): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.583644] ---[ end trace 0000000000000000 ]--- <6> [526.583645] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.583710] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.583716] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.583984] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.584184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.584267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.584351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.584430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.584508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.584584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.584672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.584743] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.584831] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.584937] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.585953] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.596603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.596862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.598184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.598255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.598324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.598392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.598459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.598527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.598592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.598674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.598741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.598808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.598874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.598939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.599004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.599070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.599136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.599202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.599269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.599333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.599398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.599473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.599545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.599617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.599687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.599753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.599819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.599887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.599959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.600027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.600098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.600166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.600235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.600309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.600382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.600456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.600527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.600598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.600667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.600734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.600800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.600871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.600938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.601005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.601073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.601145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.601216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.601285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.601355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.601423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.601490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.601556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.601633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.601702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.601773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.601841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.601910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.601976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.602042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.602112] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.602228] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.603081] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10824, lrc_seqno=10824, guc_id=0, flags=0x73 in no process [-1] <7> [526.603084] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.603141] ------------[ cut here ]------------ <4> [526.603142] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.603143] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#4: kworker/u64:388/11019 <4> [526.603208] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.603266] efi_pstore nfnetlink autofs4 <4> [526.603269] CPU: 4 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.603272] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.603273] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.603274] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.603279] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.603342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.603344] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.603346] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.603347] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.603349] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.603350] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.603351] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.603352] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [526.603353] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.603355] CR2: 00000006274ecff8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.603356] PKRU: 55555554 <4> [526.603357] Call Trace: <4> [526.603358] <TASK> <4> [526.603363] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.603367] ? lock_release+0xce/0x280 <4> [526.603373] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.603377] process_one_work+0x22e/0x6b0 <4> [526.603383] worker_thread+0x1e8/0x3d0 <4> [526.603386] ? __pfx_worker_thread+0x10/0x10 <4> [526.603388] kthread+0x11f/0x250 <4> [526.603391] ? __pfx_kthread+0x10/0x10 <4> [526.603394] ret_from_fork+0x344/0x3a0 <4> [526.603396] ? __pfx_kthread+0x10/0x10 <4> [526.603399] ret_from_fork_asm+0x1a/0x30 <4> [526.603406] </TASK> <4> [526.603407] irq event stamp: 778781 <4> [526.603408] hardirqs last enabled at (778787): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.603411] hardirqs last disabled at (778792): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.603413] softirqs last enabled at (777876): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.603415] softirqs last disabled at (777869): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.603418] ---[ end trace 0000000000000000 ]--- <6> [526.603419] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.603487] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.603493] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.603504] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.603599] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.603766] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.603974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.604063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.604149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.604227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.604303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.604377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.604452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.604523] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.604616] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.604724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.605729] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.615609] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.615880] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.617187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.617258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.617325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.617393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.617460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.617527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.617597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.617666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.617732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.617797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.617861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.617925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.617991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.618056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.618120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.618184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.618248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.618314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.618379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.618452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.618524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.618592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.618677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.618745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.618815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.618884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.618956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.619025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.619092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.619160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.619228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.619302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.619377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.619450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.619519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.619588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.619669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.619737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.619806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.619877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.619944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.620009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.620073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.620142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.620208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.620272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.620336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.620403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.620466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.620531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.620603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.620671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.620738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.620805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.620871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.620935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.620999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.621066] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.621184] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.622037] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10824, lrc_seqno=10824, guc_id=0, flags=0x73 in no process [-1] <7> [526.622040] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.622098] ------------[ cut here ]------------ <4> [526.622099] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.622100] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#2: kworker/u64:391/11022 <4> [526.622167] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.622226] efi_pstore nfnetlink autofs4 <4> [526.622230] CPU: 2 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.622233] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.622234] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.622235] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.622240] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.622304] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.622305] RSP: 0000:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.622307] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.622309] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.622310] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.622311] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.622312] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.622313] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [526.622315] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.622316] CR2: 000078650ffa9000 CR3: 0000000165c07004 CR4: 0000000000f72ef0 <4> [526.622317] PKRU: 55555554 <4> [526.622318] Call Trace: <4> [526.622319] <TASK> <4> [526.622324] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.622329] ? lock_release+0xce/0x280 <4> [526.622335] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.622340] process_one_work+0x22e/0x6b0 <4> [526.622346] worker_thread+0x1e8/0x3d0 <4> [526.622348] ? __pfx_worker_thread+0x10/0x10 <4> [526.622351] kthread+0x11f/0x250 <4> [526.622354] ? __pfx_kthread+0x10/0x10 <4> [526.622357] ret_from_fork+0x344/0x3a0 <4> [526.622359] ? __pfx_kthread+0x10/0x10 <4> [526.622362] ret_from_fork_asm+0x1a/0x30 <4> [526.622369] </TASK> <4> [526.622370] irq event stamp: 937461 <4> [526.622371] hardirqs last enabled at (937467): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.622374] hardirqs last disabled at (937472): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.622376] softirqs last enabled at (936556): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.622378] softirqs last disabled at (936551): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.622381] ---[ end trace 0000000000000000 ]--- <7> [526.622634] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.622729] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.624457] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10825, lrc_seqno=10825, guc_id=0, flags=0x73 in no process [-1] <7> [526.624462] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.624523] ------------[ cut here ]------------ <4> [526.624524] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.624526] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#10: kworker/u64:391/11022 <4> [526.624608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.624679] efi_pstore nfnetlink autofs4 <4> [526.624683] CPU: 10 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.624686] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.624687] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.624688] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.624693] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.624760] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.624762] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.624764] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.624766] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.624767] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.624768] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.624769] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.624770] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [526.624771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.624773] CR2: 0000652fc0be1478 CR3: 0000000150a21005 CR4: 0000000000f72ef0 <4> [526.624774] PKRU: 55555554 <4> [526.624775] Call Trace: <4> [526.624776] <TASK> <4> [526.624781] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.624786] ? lock_release+0xce/0x280 <4> [526.624791] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.624796] process_one_work+0x22e/0x6b0 <4> [526.624802] worker_thread+0x1e8/0x3d0 <4> [526.624804] ? __pfx_worker_thread+0x10/0x10 <4> [526.624806] kthread+0x11f/0x250 <4> [526.624810] ? __pfx_kthread+0x10/0x10 <4> [526.624813] ret_from_fork+0x344/0x3a0 <4> [526.624815] ? __pfx_kthread+0x10/0x10 <4> [526.624817] ret_from_fork_asm+0x1a/0x30 <4> [526.624825] </TASK> <4> [526.624826] irq event stamp: 938375 <4> [526.624827] hardirqs last enabled at (938381): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.624830] hardirqs last disabled at (938386): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.624832] softirqs last enabled at (937626): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.624834] softirqs last disabled at (937621): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.624837] ---[ end trace 0000000000000000 ]--- <6> [526.624838] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.624904] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.624910] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.625136] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.625346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.625441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.625525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.625608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.625685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.625761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.625838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.625910] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.625999] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.626105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.627109] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.637603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.637863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.639172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.639252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.639325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.639395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.639464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.639531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.639605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.639679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.639747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.639816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.639882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.639950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.640016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.640084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.640149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.640214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.640277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.640341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.640405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.640479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.640551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.640627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.640698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.640768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.640835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.640903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.640974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.641045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.641112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.641181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.641249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.641324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.641397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.641469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.641539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.641616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.641686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.641751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.641816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.641883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.641949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.642014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.642077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.642144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.642210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.642276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.642342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.642409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.642474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.642540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.642620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.642688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.642755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.642820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.642885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.642948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.643011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.643077] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.643196] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.644050] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10825, lrc_seqno=10825, guc_id=0, flags=0x73 in no process [-1] <7> [526.644053] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.644109] ------------[ cut here ]------------ <4> [526.644110] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.644111] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#1: kworker/u64:390/11021 <4> [526.644177] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.644236] efi_pstore nfnetlink autofs4 <4> [526.644239] CPU: 1 UID: 0 PID: 11021 Comm: kworker/u64:390 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.644242] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.644243] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.644244] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.644249] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.644314] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.644315] RSP: 0018:ffffc90022d8fc98 EFLAGS: 00010246 <4> [526.644317] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.644319] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.644320] RBP: ffffc90022d8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.644321] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.644322] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.644323] FS: 0000000000000000(0000) GS:ffff8888dad5d000(0000) knlGS:0000000000000000 <4> [526.644324] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.644326] CR2: 00007bffbc70a368 CR3: 0000000003448002 CR4: 0000000000f72ef0 <4> [526.644327] PKRU: 55555554 <4> [526.644328] Call Trace: <4> [526.644329] <TASK> <4> [526.644334] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.644339] ? lock_release+0xce/0x280 <4> [526.644344] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.644349] process_one_work+0x22e/0x6b0 <4> [526.644355] worker_thread+0x1e8/0x3d0 <4> [526.644357] ? __pfx_worker_thread+0x10/0x10 <4> [526.644360] kthread+0x11f/0x250 <4> [526.644363] ? __pfx_kthread+0x10/0x10 <4> [526.644366] ret_from_fork+0x344/0x3a0 <4> [526.644368] ? __pfx_kthread+0x10/0x10 <4> [526.644371] ret_from_fork_asm+0x1a/0x30 <4> [526.644378] </TASK> <4> [526.644379] irq event stamp: 903697 <4> [526.644380] hardirqs last enabled at (903703): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.644383] hardirqs last disabled at (903708): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.644385] softirqs last enabled at (902792): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.644387] softirqs last disabled at (902763): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.644389] ---[ end trace 0000000000000000 ]--- <6> [526.644391] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.644455] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.644461] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.644473] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.644568] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.644816] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.645023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.645110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.645199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.645281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.645361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.645437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.645513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.645584] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.645687] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.645796] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.646800] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.656603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.656863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.658181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.658253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.658321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.658390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.658459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.658524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.658590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.658673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.658742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.658807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.658875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.658941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.659007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.659071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.659135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.659201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.659268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.659336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.659401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.659474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.659546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.659621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.659692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.659759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.659825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.659893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.659964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.660033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.660100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.660170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.660239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.660313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.660387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.660460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.660532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.660606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.660676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.660744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.660810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.660880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.660949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.661019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.661086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.661156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.661224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.661290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.661355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.661423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.661486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.661550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.661625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.661692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.661759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.661826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.661893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.661958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.662023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.662090] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.662208] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.662632] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10825, lrc_seqno=10825, guc_id=0, flags=0x73 in no process [-1] <7> [526.662642] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.662999] ------------[ cut here ]------------ <4> [526.663002] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.663006] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#5: kworker/u64:388/11019 <4> [526.663110] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.663171] efi_pstore nfnetlink autofs4 <4> [526.663175] CPU: 5 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.663180] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.663181] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.663184] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.663191] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <7> [526.663192] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [526.663302] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.663305] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.663308] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.663310] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.663312] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.663313] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.663315] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.663317] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [526.663319] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.663321] CR2: 0000652fc0bde9b8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.663323] PKRU: 55555554 <4> [526.663324] Call Trace: <4> [526.663326] <TASK> <4> [526.663336] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.663344] ? lock_release+0xce/0x280 <4> [526.663352] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.663361] process_one_work+0x22e/0x6b0 <4> [526.663369] worker_thread+0x1e8/0x3d0 <4> [526.663374] ? __pfx_worker_thread+0x10/0x10 <4> [526.663377] kthread+0x11f/0x250 <4> [526.663382] ? __pfx_kthread+0x10/0x10 <4> [526.663388] ret_from_fork+0x344/0x3a0 <4> [526.663391] ? __pfx_kthread+0x10/0x10 <4> [526.663395] ret_from_fork_asm+0x1a/0x30 <7> [526.663339] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [526.663408] </TASK> <4> [526.663409] irq event stamp: 782627 <4> [526.663411] hardirqs last enabled at (782633): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.663414] hardirqs last disabled at (782638): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.663417] softirqs last enabled at (781722): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.663420] softirqs last disabled at (781715): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.663423] ---[ end trace 0000000000000000 ]--- <5> [526.668589] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10833, lrc_seqno=10833, guc_id=0, flags=0x73 in no process [-1] <7> [526.668592] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.668674] ------------[ cut here ]------------ <4> [526.668676] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.668677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#2: kworker/u64:391/11022 <4> [526.668743] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.668802] efi_pstore nfnetlink autofs4 <4> [526.668806] CPU: 2 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.668809] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.668810] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.668811] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.668816] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.668880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.668882] RSP: 0000:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.668884] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.668885] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.668886] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.668887] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.668888] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.668890] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [526.668891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.668892] CR2: 000078650ffa9000 CR3: 0000000003448001 CR4: 0000000000f72ef0 <4> [526.668894] PKRU: 55555554 <4> [526.668895] Call Trace: <4> [526.668896] <TASK> <4> [526.668901] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.668905] ? lock_release+0xce/0x280 <4> [526.668911] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.668916] process_one_work+0x22e/0x6b0 <4> [526.668921] worker_thread+0x1e8/0x3d0 <4> [526.668924] ? __pfx_worker_thread+0x10/0x10 <4> [526.668926] kthread+0x11f/0x250 <4> [526.668929] ? __pfx_kthread+0x10/0x10 <4> [526.668932] ret_from_fork+0x344/0x3a0 <4> [526.668934] ? __pfx_kthread+0x10/0x10 <4> [526.668937] ret_from_fork_asm+0x1a/0x30 <4> [526.668944] </TASK> <4> [526.668945] irq event stamp: 940057 <4> [526.668946] hardirqs last enabled at (940063): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.668949] hardirqs last disabled at (940068): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.668951] softirqs last enabled at (939290): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.668954] softirqs last disabled at (939263): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.668956] ---[ end trace 0000000000000000 ]--- <6> [526.668957] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.669021] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.669027] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.669306] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.669506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.669592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.669691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.669770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.669846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.669919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.669993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.670065] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.670152] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.670261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.671282] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.681602] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.681862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.683168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.683240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.683308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.683376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.683444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.683511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.683577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.683654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.683719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.683783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.683850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.683913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.683977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.684043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.684107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.684172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.684235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.684299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.684362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.684437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.684508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.684577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.684657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.684725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.684792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.684862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.684935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.685005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.685074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.685142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.685211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.685283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.685356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.685432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.685504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.685571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.685648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.685716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.685779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.685847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.685914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.685981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.686048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.686119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.686184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.686250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.686314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.686380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.686444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.686511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.686581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.686659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.686728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.686793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.686860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.686924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.686987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.687055] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.687170] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.688024] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10833, lrc_seqno=10833, guc_id=0, flags=0x73 in no process [-1] <7> [526.688027] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.688126] ------------[ cut here ]------------ <4> [526.688127] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.688128] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:388/11019 <4> [526.688194] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.688252] efi_pstore nfnetlink autofs4 <4> [526.688256] CPU: 8 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.688259] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.688260] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.688261] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.688266] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.688331] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.688333] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.688335] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.688336] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.688337] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.688338] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.688340] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.688341] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.688342] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.688344] CR2: 000078650ffa1000 CR3: 0000000003448006 CR4: 0000000000f72ef0 <4> [526.688345] PKRU: 55555554 <4> [526.688346] Call Trace: <4> [526.688347] <TASK> <4> [526.688352] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.688357] ? lock_release+0xce/0x280 <4> [526.688362] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.688367] process_one_work+0x22e/0x6b0 <4> [526.688374] worker_thread+0x1e8/0x3d0 <4> [526.688376] ? __pfx_worker_thread+0x10/0x10 <4> [526.688378] kthread+0x11f/0x250 <4> [526.688382] ? __pfx_kthread+0x10/0x10 <4> [526.688385] ret_from_fork+0x344/0x3a0 <4> [526.688387] ? __pfx_kthread+0x10/0x10 <4> [526.688389] ret_from_fork_asm+0x1a/0x30 <4> [526.688397] </TASK> <4> [526.688398] irq event stamp: 786035 <4> [526.688399] hardirqs last enabled at (786041): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.688401] hardirqs last disabled at (786046): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.688403] softirqs last enabled at (785032): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.688406] softirqs last disabled at (785027): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.688408] ---[ end trace 0000000000000000 ]--- <6> [526.688409] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.688475] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.688480] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.688787] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.688882] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.688978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.689178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.689260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.689344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.689426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.689503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.689579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.689668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.689743] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.689830] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.689936] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.690939] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.701603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.701861] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.703129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.703201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.703271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.703344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.703411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.703478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.703544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.703616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.703681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.703747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.703814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.703879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.703943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.704009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.704076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.704144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.704212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.704278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.704343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.704417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.704491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.704562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.704642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.704713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.704780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.704850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.704921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.704991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.705059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.705127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.705197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.705273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.705348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.705422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.705489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.705556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.705630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.705698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.705763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.705832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.705898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.705964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.706029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.706097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.706164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.706231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.706295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.706361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.706426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.706492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.706558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.706635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.706702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.706766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.706832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.706900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.706966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.707034] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.707146] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.707996] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10833, lrc_seqno=10833, guc_id=0, flags=0x73 in no process [-1] <7> [526.707998] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.708082] ------------[ cut here ]------------ <4> [526.708083] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.708084] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:388/11019 <4> [526.708150] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.708207] efi_pstore nfnetlink autofs4 <4> [526.708211] CPU: 8 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.708214] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.708215] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.708216] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.708221] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.708285] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.708286] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.708288] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.708289] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.708291] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.708292] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.708293] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.708294] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.708295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.708297] CR2: 000078650ffa1000 CR3: 0000000003448006 CR4: 0000000000f72ef0 <4> [526.708298] PKRU: 55555554 <4> [526.708299] Call Trace: <4> [526.708300] <TASK> <4> [526.708305] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.708310] ? lock_release+0xce/0x280 <4> [526.708315] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.708320] process_one_work+0x22e/0x6b0 <4> [526.708325] worker_thread+0x1e8/0x3d0 <4> [526.708328] ? __pfx_worker_thread+0x10/0x10 <4> [526.708330] kthread+0x11f/0x250 <4> [526.708333] ? __pfx_kthread+0x10/0x10 <4> [526.708337] ret_from_fork+0x344/0x3a0 <4> [526.708339] ? __pfx_kthread+0x10/0x10 <4> [526.708341] ret_from_fork_asm+0x1a/0x30 <4> [526.708349] </TASK> <4> [526.708350] irq event stamp: 789155 <4> [526.708351] hardirqs last enabled at (789161): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.708354] hardirqs last disabled at (789166): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.708356] softirqs last enabled at (788152): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.708358] softirqs last disabled at (788145): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.708360] ---[ end trace 0000000000000000 ]--- <7> [526.708616] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.708709] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.710456] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10834, lrc_seqno=10834, guc_id=0, flags=0x73 in no process [-1] <7> [526.710458] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.710515] ------------[ cut here ]------------ <4> [526.710516] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.710517] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:388/11019 <4> [526.710582] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.710642] efi_pstore nfnetlink autofs4 <4> [526.710646] CPU: 8 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.710649] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.710650] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <7> [526.710648] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:559] <4> [526.710651] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.710656] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.710719] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.710721] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.710722] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.710724] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.710725] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.710726] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.710727] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.710728] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.710729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.710730] CR2: 000078650ffa1000 CR3: 0000000003448006 CR4: 0000000000f72ef0 <4> [526.710732] PKRU: 55555554 <4> [526.710733] Call Trace: <4> [526.710734] <TASK> <4> [526.710738] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.710743] ? lock_release+0xce/0x280 <4> [526.710748] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.710753] process_one_work+0x22e/0x6b0 <4> [526.710759] worker_thread+0x1e8/0x3d0 <4> [526.710761] ? __pfx_worker_thread+0x10/0x10 <4> [526.710763] kthread+0x11f/0x250 <4> [526.710766] ? __pfx_kthread+0x10/0x10 <4> [526.710770] ret_from_fork+0x344/0x3a0 <4> [526.710772] ? __pfx_kthread+0x10/0x10 <4> [526.710774] ret_from_fork_asm+0x1a/0x30 <4> [526.710782] </TASK> <4> [526.710783] irq event stamp: 790037 <4> [526.710783] hardirqs last enabled at (790043): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.710786] hardirqs last disabled at (790048): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.710788] softirqs last enabled at (788152): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.710791] softirqs last disabled at (788145): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.710793] ---[ end trace 0000000000000000 ]--- <6> [526.710794] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.710859] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.710865] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.710959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.711162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.711248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.711348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.711431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.711515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.711598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.711705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.711780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.711870] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.711976] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.712986] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.723604] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.723867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.725181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.725259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.725331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.725401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.725469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.725537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.725614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.725682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.725750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.725817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.725884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.725950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.726017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.726081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.726145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.726209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.726275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.726338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.726401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.726476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.726550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.726627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.726700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.726770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.726838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.726909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.726983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.727055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.727124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.727194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.727263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.727336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.727410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.727482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.727552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.727630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.727696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.727764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.727828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.727896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.727963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.728029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.728094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.728164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.728231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.728300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.728367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.728433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.728499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.728563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.728639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.728706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.728772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.728837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.728904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.728969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.729035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.729102] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.729220] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.730068] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10834, lrc_seqno=10834, guc_id=0, flags=0x73 in no process [-1] <7> [526.730070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.730126] ------------[ cut here ]------------ <4> [526.730127] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.730129] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#2: kworker/u64:391/11022 <4> [526.730209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.730267] efi_pstore nfnetlink autofs4 <4> [526.730271] CPU: 2 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.730274] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.730275] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.730276] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.730281] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.730347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.730348] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.730351] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.730352] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.730353] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.730354] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.730355] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.730356] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [526.730358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.730359] CR2: 000078650ffa9000 CR3: 000000010808b005 CR4: 0000000000f72ef0 <4> [526.730360] PKRU: 55555554 <4> [526.730361] Call Trace: <4> [526.730362] <TASK> <4> [526.730367] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.730372] ? lock_release+0xce/0x280 <4> [526.730377] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.730382] process_one_work+0x22e/0x6b0 <4> [526.730388] worker_thread+0x1e8/0x3d0 <4> [526.730390] ? __pfx_worker_thread+0x10/0x10 <4> [526.730392] kthread+0x11f/0x250 <4> [526.730396] ? __pfx_kthread+0x10/0x10 <4> [526.730399] ret_from_fork+0x344/0x3a0 <4> [526.730401] ? __pfx_kthread+0x10/0x10 <4> [526.730404] ret_from_fork_asm+0x1a/0x30 <4> [526.730411] </TASK> <4> [526.730412] irq event stamp: 944171 <4> [526.730413] hardirqs last enabled at (944177): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.730415] hardirqs last disabled at (944182): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.730417] softirqs last enabled at (943052): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.730420] softirqs last disabled at (943045): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.730422] ---[ end trace 0000000000000000 ]--- <6> [526.730424] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.730488] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.730496] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.730624] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.730819] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.730919] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.731121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.731200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.731283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.731360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.731438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.731517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.731602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.731678] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.731768] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.731876] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.732883] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.742603] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.742863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.744191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.744263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.744331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.744399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.744467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.744534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.744608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.744676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.744742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.744808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.744874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.744939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.745004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.745069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.745134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.745199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.745263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.745328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.745392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.745465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.745538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.745613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.745685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.745753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.745821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.745891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.745964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.746034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.746102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.746171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.746241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.746317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.746392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.746465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.746535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.746610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.746678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.746745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.746811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.746881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.746947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.747012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.747081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.747153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.747222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.747289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.747357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.747426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.747492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.747559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.747639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.747706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.747772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.747839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.747907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.747973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.748038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.748105] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.748238] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.749096] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10834, lrc_seqno=10834, guc_id=0, flags=0x73 in no process [-1] <7> [526.749099] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.749156] ------------[ cut here ]------------ <4> [526.749157] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.749158] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#3: kworker/u64:214/10845 <4> [526.749225] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.749283] efi_pstore nfnetlink autofs4 <4> [526.749287] CPU: 3 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.749290] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.749291] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.749293] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.749298] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.749364] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.749366] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.749368] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.749369] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.749370] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.749371] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.749372] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.749374] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [526.749375] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.749376] CR2: 00007d4288a705d0 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.749378] PKRU: 55555554 <4> [526.749379] Call Trace: <4> [526.749380] <TASK> <4> [526.749385] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.749390] ? lock_release+0xce/0x280 <4> [526.749395] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.749400] process_one_work+0x22e/0x6b0 <4> [526.749406] worker_thread+0x1e8/0x3d0 <4> [526.749409] ? __pfx_worker_thread+0x10/0x10 <4> [526.749411] kthread+0x11f/0x250 <4> [526.749414] ? __pfx_kthread+0x10/0x10 <4> [526.749417] ret_from_fork+0x344/0x3a0 <4> [526.749419] ? __pfx_kthread+0x10/0x10 <4> [526.749422] ret_from_fork_asm+0x1a/0x30 <4> [526.749429] </TASK> <4> [526.749430] irq event stamp: 699769 <4> [526.749431] hardirqs last enabled at (699775): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.749434] hardirqs last disabled at (699780): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.749436] softirqs last enabled at (698760): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.749438] softirqs last disabled at (698753): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.749441] ---[ end trace 0000000000000000 ]--- <7> [526.749931] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.750026] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.755695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10850, lrc_seqno=10850, guc_id=0, flags=0x73 in no process [-1] <7> [526.755698] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.755758] ------------[ cut here ]------------ <4> [526.755759] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.755760] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#1: kworker/u64:390/11021 <4> [526.755829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.755887] efi_pstore nfnetlink autofs4 <4> [526.755891] CPU: 1 UID: 0 PID: 11021 Comm: kworker/u64:390 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.755894] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.755895] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.755896] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.755900] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.755967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.755969] RSP: 0018:ffffc90022d8fc98 EFLAGS: 00010246 <4> [526.755971] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.755972] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.755973] RBP: ffffc90022d8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.755974] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.755975] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.755976] FS: 0000000000000000(0000) GS:ffff8888dad5d000(0000) knlGS:0000000000000000 <4> [526.755978] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.755979] CR2: 00007bffbc70a368 CR3: 0000000003448002 CR4: 0000000000f72ef0 <4> [526.755980] PKRU: 55555554 <4> [526.755981] Call Trace: <4> [526.755982] <TASK> <4> [526.755987] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.755992] ? lock_release+0xce/0x280 <4> [526.755998] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.756003] process_one_work+0x22e/0x6b0 <4> [526.756008] worker_thread+0x1e8/0x3d0 <4> [526.756011] ? __pfx_worker_thread+0x10/0x10 <4> [526.756013] kthread+0x11f/0x250 <4> [526.756016] ? __pfx_kthread+0x10/0x10 <4> [526.756020] ret_from_fork+0x344/0x3a0 <4> [526.756022] ? __pfx_kthread+0x10/0x10 <4> [526.756024] ret_from_fork_asm+0x1a/0x30 <4> [526.756032] </TASK> <4> [526.756033] irq event stamp: 905353 <4> [526.756034] hardirqs last enabled at (905359): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.756036] hardirqs last disabled at (905364): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.756038] softirqs last enabled at (904434): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.756041] softirqs last disabled at (904429): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.756043] ---[ end trace 0000000000000000 ]--- <6> [526.756045] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.756109] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.756115] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.756396] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.756601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.756685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.756770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.756850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.756927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.757003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.757078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.757151] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.757238] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.757345] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.758348] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.768600] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.768860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.770160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.770231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.770299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.770368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.770436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.770503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.770570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.770648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.770716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.770782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.770848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.770914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.770979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.771044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.771109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.771175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.771242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.771308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.771373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.771447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.771520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.771589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.771674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.771742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.771808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.771876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.771947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.772015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.772085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.772152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.772220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.772293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.772365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.772439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.772508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.772579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.772657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.772727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.772793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.772860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.772926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.772992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.773059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.773127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.773194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.773259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.773326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.773393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.773460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.773526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.773598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.773664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.773730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.773794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.773860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.773924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.773990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.774058] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.774175] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.775029] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10850, lrc_seqno=10850, guc_id=0, flags=0x73 in no process [-1] <7> [526.775032] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.775118] ------------[ cut here ]------------ <4> [526.775119] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.775120] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.775188] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.775246] efi_pstore nfnetlink autofs4 <4> [526.775250] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.775253] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.775254] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.775255] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.775260] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.775323] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.775325] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.775327] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.775328] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.775329] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.775330] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.775331] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.775332] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.775334] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.775335] CR2: 000078650ffa1000 CR3: 0000000003448006 CR4: 0000000000f72ef0 <4> [526.775336] PKRU: 55555554 <4> [526.775338] Call Trace: <4> [526.775338] <TASK> <4> [526.775344] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.775348] ? lock_release+0xce/0x280 <4> [526.775354] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.775358] process_one_work+0x22e/0x6b0 <4> [526.775364] worker_thread+0x1e8/0x3d0 <4> [526.775367] ? __pfx_worker_thread+0x10/0x10 <4> [526.775369] kthread+0x11f/0x250 <4> [526.775372] ? __pfx_kthread+0x10/0x10 <4> [526.775375] ret_from_fork+0x344/0x3a0 <4> [526.775377] ? __pfx_kthread+0x10/0x10 <4> [526.775380] ret_from_fork_asm+0x1a/0x30 <4> [526.775387] </TASK> <4> [526.775388] irq event stamp: 703335 <4> [526.775389] hardirqs last enabled at (703341): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.775392] hardirqs last disabled at (703346): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.775394] softirqs last enabled at (702332): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.775396] softirqs last disabled at (702325): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.775398] ---[ end trace 0000000000000000 ]--- <6> [526.775400] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.775464] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.775470] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.775482] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.775575] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.775798] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.776007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.776095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.776181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.776262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.776338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.776413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.776487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.776559] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.776659] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.776769] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.777779] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.787600] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.787859] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.789111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.789185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.789253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.789322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.789389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.789456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.789524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.789596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.789665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.789732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.789798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.789864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.789929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.789996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.790063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.790129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.790195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.790260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.790325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.790399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.790470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.790541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.790625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.790695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.790762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.790831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.790905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.790976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.791048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.791121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.791194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.791270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.791344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.791418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.791487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.791556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.791632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.791701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.791769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.791837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.791903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.791967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.792033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.792104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.792172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.792243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.792309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.792376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.792443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.792508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.792576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.792654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.792720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.792784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.792850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.792917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.792981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.793048] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.793166] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.794016] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10850, lrc_seqno=10850, guc_id=0, flags=0x73 in no process [-1] <7> [526.794019] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.794076] ------------[ cut here ]------------ <4> [526.794077] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.794078] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#5: kworker/u64:388/11019 <4> [526.794145] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.794204] efi_pstore nfnetlink autofs4 <4> [526.794208] CPU: 5 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.794211] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.794212] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.794214] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.794218] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.794282] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.794284] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.794287] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.794288] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.794290] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.794291] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.794292] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.794294] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [526.794295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.794297] CR2: 0000652fc0bde9b8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.794299] PKRU: 55555554 <4> [526.794300] Call Trace: <4> [526.794301] <TASK> <4> [526.794306] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.794312] ? lock_release+0xce/0x280 <4> [526.794317] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.794323] process_one_work+0x22e/0x6b0 <4> [526.794329] worker_thread+0x1e8/0x3d0 <4> [526.794332] ? __pfx_worker_thread+0x10/0x10 <4> [526.794334] kthread+0x11f/0x250 <4> [526.794337] ? __pfx_kthread+0x10/0x10 <4> [526.794341] ret_from_fork+0x344/0x3a0 <4> [526.794343] ? __pfx_kthread+0x10/0x10 <4> [526.794346] ret_from_fork_asm+0x1a/0x30 <4> [526.794353] </TASK> <4> [526.794355] irq event stamp: 793817 <4> [526.794356] hardirqs last enabled at (793823): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.794359] hardirqs last disabled at (793828): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.794361] softirqs last enabled at (792816): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.794363] softirqs last disabled at (792809): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.794366] ---[ end trace 0000000000000000 ]--- <7> [526.794626] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.794781] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.796932] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10851, lrc_seqno=10851, guc_id=0, flags=0x73 in no process [-1] <7> [526.796935] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.796993] ------------[ cut here ]------------ <4> [526.796994] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.796996] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#8: kworker/u64:214/10845 <4> [526.797065] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.797123] efi_pstore nfnetlink autofs4 <4> [526.797127] CPU: 8 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.797130] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.797131] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.797132] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.797137] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.797204] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.797206] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.797208] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.797210] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.797211] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.797212] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.797213] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.797214] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [526.797216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.797217] CR2: 000078650ffa1000 CR3: 000000010808b001 CR4: 0000000000f72ef0 <4> [526.797218] PKRU: 55555554 <4> [526.797219] Call Trace: <4> [526.797220] <TASK> <4> [526.797225] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.797230] ? lock_release+0xce/0x280 <4> [526.797235] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.797240] process_one_work+0x22e/0x6b0 <4> [526.797246] worker_thread+0x1e8/0x3d0 <4> [526.797248] ? __pfx_worker_thread+0x10/0x10 <4> [526.797251] kthread+0x11f/0x250 <4> [526.797254] ? __pfx_kthread+0x10/0x10 <4> [526.797257] ret_from_fork+0x344/0x3a0 <4> [526.797259] ? __pfx_kthread+0x10/0x10 <4> [526.797262] ret_from_fork_asm+0x1a/0x30 <4> [526.797269] </TASK> <4> [526.797270] irq event stamp: 704767 <4> [526.797271] hardirqs last enabled at (704773): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.797274] hardirqs last disabled at (704778): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.797276] softirqs last enabled at (703742): [<ffffffff813346a3>] kernel_fpu_end+0x53/0x70 <4> [526.797278] softirqs last disabled at (703740): [<ffffffff81334d84>] kernel_fpu_begin_mask+0xc4/0x120 <4> [526.797281] ---[ end trace 0000000000000000 ]--- <6> [526.797282] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.797347] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.797354] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.797599] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.797811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.797931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.798039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.798143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.798258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.798343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.798423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.798527] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.798654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.798764] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.799776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.809601] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.809860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.811183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.811254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.811322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.811392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.811460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.811527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.811599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.811666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.811733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.811799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.811865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.811930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.811995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.812061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.812126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.812191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.812255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.812319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.812383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.812456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.812528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.812603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.812673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.812741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.812808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.812877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.812949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.813019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.813089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.813159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.813227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.813301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.813376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.813449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.813521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.813597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.813667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.813735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.813801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.813870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.813936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.814005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.814070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.814142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.814208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.814274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.814338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.814404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.814468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.814531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.814604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.814671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.814738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.814802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.814867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.814931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.814996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.815066] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.815179] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.816044] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10851, lrc_seqno=10851, guc_id=0, flags=0x73 in no process [-1] <7> [526.816047] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.816105] ------------[ cut here ]------------ <4> [526.816106] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.816107] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#5: kworker/u64:388/11019 <4> [526.816174] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.816234] efi_pstore nfnetlink autofs4 <4> [526.816238] CPU: 5 UID: 0 PID: 11019 Comm: kworker/u64:388 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.816241] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.816242] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.816243] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.816248] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.816312] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.816314] RSP: 0018:ffffc90022d7fc98 EFLAGS: 00010246 <4> [526.816316] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.816317] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.816318] RBP: ffffc90022d7fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.816319] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.816320] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.816322] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [526.816323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.816324] CR2: 0000652fc0bde9b8 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [526.816326] PKRU: 55555554 <4> [526.816327] Call Trace: <4> [526.816328] <TASK> <4> [526.816333] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.816338] ? lock_release+0xce/0x280 <4> [526.816343] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.816348] process_one_work+0x22e/0x6b0 <4> [526.816354] worker_thread+0x1e8/0x3d0 <4> [526.816356] ? __pfx_worker_thread+0x10/0x10 <4> [526.816359] kthread+0x11f/0x250 <4> [526.816362] ? __pfx_kthread+0x10/0x10 <4> [526.816365] ret_from_fork+0x344/0x3a0 <4> [526.816367] ? __pfx_kthread+0x10/0x10 <4> [526.816370] ret_from_fork_asm+0x1a/0x30 <4> [526.816377] </TASK> <4> [526.816378] irq event stamp: 796963 <4> [526.816379] hardirqs last enabled at (796969): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.816381] hardirqs last disabled at (796974): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.816383] softirqs last enabled at (796058): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.816386] softirqs last disabled at (796053): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.816388] ---[ end trace 0000000000000000 ]--- <6> [526.816390] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.816454] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.816460] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.816473] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.816586] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.816805] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.817021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.817115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.817204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.817288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.817370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.817451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.817532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.817614] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.817708] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.817821] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.818829] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.828605] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.828882] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.830215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.830297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.830373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.830447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.830519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.830595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.830667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.830738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.830808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.830880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.830949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.831019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.831086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.831155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.831225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.831294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.831364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.831432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.831501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.831580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.831677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.831767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.831856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.831931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.832003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.832079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.832157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.832233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.832306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.832381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.832456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.832535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.832617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.832696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.832771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.832846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.832918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.832990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.833061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.833134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.833206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.833277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.833347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.833420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.833490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.833562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.833641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.833713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.833783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.833852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.833926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.833997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.834068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.834138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.834211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.834281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.834351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.834424] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.834546] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.835400] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10851, lrc_seqno=10851, guc_id=0, flags=0x73 in no process [-1] <7> [526.835403] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.835465] ------------[ cut here ]------------ <4> [526.835466] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.835467] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#2: kworker/u64:391/11022 <4> [526.835538] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.835603] efi_pstore nfnetlink autofs4 <4> [526.835607] CPU: 2 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.835610] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.835611] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.835613] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.835618] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.835688] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.835690] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.835692] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.835694] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.835695] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.835696] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.835697] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.835698] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [526.835700] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.835701] CR2: 000078650ffa9000 CR3: 0000000003448001 CR4: 0000000000f72ef0 <4> [526.835703] PKRU: 55555554 <4> [526.835704] Call Trace: <4> [526.835704] <TASK> <4> [526.835710] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.835715] ? lock_release+0xce/0x280 <4> [526.835720] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.835725] process_one_work+0x22e/0x6b0 <4> [526.835731] worker_thread+0x1e8/0x3d0 <4> [526.835734] ? __pfx_worker_thread+0x10/0x10 <4> [526.835736] kthread+0x11f/0x250 <4> [526.835739] ? __pfx_kthread+0x10/0x10 <4> [526.835743] ret_from_fork+0x344/0x3a0 <4> [526.835745] ? __pfx_kthread+0x10/0x10 <4> [526.835747] ret_from_fork_asm+0x1a/0x30 <4> [526.835755] </TASK> <4> [526.835756] irq event stamp: 947715 <4> [526.835757] hardirqs last enabled at (947721): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.835760] hardirqs last disabled at (947726): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.835762] softirqs last enabled at (946784): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.835764] softirqs last disabled at (946779): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.835766] ---[ end trace 0000000000000000 ]--- <7> [526.836088] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.836191] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [526.842261] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10859, lrc_seqno=10859, guc_id=0, flags=0x73 in no process [-1] <7> [526.842265] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.842329] ------------[ cut here ]------------ <4> [526.842330] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.842331] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#10: kworker/u64:391/11022 <4> [526.842403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.842461] efi_pstore nfnetlink autofs4 <4> [526.842465] CPU: 10 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.842468] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.842469] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.842470] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.842475] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.842541] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.842542] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.842544] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.842546] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.842547] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.842548] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.842549] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.842550] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [526.842552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.842553] CR2: 0000652fc0be1478 CR3: 0000000150a21005 CR4: 0000000000f72ef0 <4> [526.842554] PKRU: 55555554 <4> [526.842555] Call Trace: <4> [526.842556] <TASK> <4> [526.842561] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.842566] ? lock_release+0xce/0x280 <4> [526.842571] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.842576] process_one_work+0x22e/0x6b0 <4> [526.842582] worker_thread+0x1e8/0x3d0 <4> [526.842584] ? __pfx_worker_thread+0x10/0x10 <4> [526.842587] kthread+0x11f/0x250 <4> [526.842590] ? __pfx_kthread+0x10/0x10 <4> [526.842601] ret_from_fork+0x344/0x3a0 <4> [526.842604] ? __pfx_kthread+0x10/0x10 <4> [526.842608] ret_from_fork_asm+0x1a/0x30 <4> [526.842622] </TASK> <4> [526.842623] irq event stamp: 948807 <4> [526.842625] hardirqs last enabled at (948813): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.842629] hardirqs last disabled at (948818): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.842633] softirqs last enabled at (948778): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.842636] softirqs last disabled at (948771): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.842640] ---[ end trace 0000000000000000 ]--- <6> [526.842642] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.842744] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.842752] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.843021] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.843221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.843304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.843390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.843470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.843550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.843663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.843743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.843818] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.843907] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.844014] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.845040] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.855758] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.856017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.857273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.857350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.857420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.857488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.857555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.857637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.857711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.857778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.857844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.857911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.857979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.858043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.858107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.858172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.858237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.858303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.858370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.858435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.858500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.858574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.858663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.858745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.858816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.858884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.858952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.859020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.859091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.859160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.859226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.859293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.859359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.859432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.859502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.859574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.859662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.859743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.859808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.859871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.859933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.859999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.860064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.860129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.860194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.860261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.860325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.860391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.860455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.860519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.860580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.860663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.860749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.860815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.860880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.860944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.861009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.861072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.861134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.861199] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.861318] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.862172] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10859, lrc_seqno=10859, guc_id=0, flags=0x73 in no process [-1] <7> [526.862175] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.862232] ------------[ cut here ]------------ <4> [526.862233] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.862235] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#10: kworker/u64:391/11022 <4> [526.862301] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.862359] efi_pstore nfnetlink autofs4 <4> [526.862363] CPU: 10 UID: 0 PID: 11022 Comm: kworker/u64:391 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.862366] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.862367] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.862368] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [526.862373] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.862437] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.862439] RSP: 0018:ffffc90022d97c98 EFLAGS: 00010246 <4> [526.862441] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.862442] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.862443] RBP: ffffc90022d97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.862444] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.862445] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.862446] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [526.862448] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.862449] CR2: 0000652fc0be1478 CR3: 0000000003448003 CR4: 0000000000f72ef0 <4> [526.862450] PKRU: 55555554 <4> [526.862451] Call Trace: <4> [526.862452] <TASK> <4> [526.862457] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.862462] ? lock_release+0xce/0x280 <4> [526.862467] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.862472] process_one_work+0x22e/0x6b0 <4> [526.862478] worker_thread+0x1e8/0x3d0 <4> [526.862480] ? __pfx_worker_thread+0x10/0x10 <4> [526.862482] kthread+0x11f/0x250 <4> [526.862485] ? __pfx_kthread+0x10/0x10 <4> [526.862489] ret_from_fork+0x344/0x3a0 <4> [526.862491] ? __pfx_kthread+0x10/0x10 <4> [526.862493] ret_from_fork_asm+0x1a/0x30 <4> [526.862501] </TASK> <4> [526.862502] irq event stamp: 952013 <4> [526.862503] hardirqs last enabled at (952019): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.862505] hardirqs last disabled at (952024): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.862507] softirqs last enabled at (951102): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.862510] softirqs last disabled at (951095): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.862512] ---[ end trace 0000000000000000 ]--- <6> [526.862514] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [526.862576] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [526.862582] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [526.862604] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [526.862723] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [526.862854] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [526.863059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [526.863146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [526.863234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [526.863315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [526.863393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [526.863469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [526.863546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [526.863627] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [526.863716] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [526.863825] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [526.864832] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [526.874599] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [526.874858] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [526.876124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [526.876197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [526.876265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [526.876333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [526.876401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [526.876468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [526.876534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [526.876605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [526.876673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [526.876739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [526.876804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [526.876870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [526.876934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [526.877000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [526.877064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [526.877129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [526.877192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [526.877257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [526.877323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [526.877398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [526.877471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [526.877541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [526.877616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [526.877684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [526.877751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [526.877819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [526.877890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [526.877958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [526.878024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [526.878090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [526.878157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [526.878232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [526.878305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [526.878379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [526.878448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [526.878516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [526.878582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [526.878661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [526.878727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [526.878795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [526.878861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [526.878928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [526.878991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [526.879064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [526.879130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [526.879197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [526.879264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [526.879333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [526.879399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [526.879467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [526.879538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [526.879612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [526.879694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [526.879760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [526.879828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [526.879894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [526.879960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [526.880031] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [526.880148] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [526.880634] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=10859, lrc_seqno=10859, guc_id=0, flags=0x73 in no process [-1] <7> [526.880644] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [526.880979] ------------[ cut here ]------------ <4> [526.880981] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [526.880983] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1630 at guc_exec_queue_timedout_job+0x13d8/0x23c0 [xe], CPU#9: kworker/u64:214/10845 <4> [526.881060] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse <4> [526.881138] efi_pstore nfnetlink autofs4 <4> [526.881144] CPU: 9 UID: 0 PID: 10845 Comm: kworker/u64:214 Tainted: G S U W L 6.19.0-rc6-lgci-xe-xe-4424-b7c3274a57563fc16+ #1 PREEMPT(voluntary) <4> [526.881148] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [526.881150] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [526.881152] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [526.881135] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [526.881159] RIP: 0010:guc_exec_queue_timedout_job+0x13e1/0x23c0 [xe] <4> [526.881270] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49 <4> [526.881272] RSP: 0018:ffffc9002287fc98 EFLAGS: 00010246 <4> [526.881275] RAX: ffffffffa11f716d RBX: 0000000000000000 RCX: 0000000000000000 <4> [526.881277] RDX: ffff888104d58110 RSI: ffffffffa11f716d RDI: ffffffffa1003da0 <4> [526.881279] RBP: ffffc9002287fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [526.881281] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [526.881283] R13: ffff888104d58110 R14: ffff888165698818 R15: 00000000ffffffc2 <4> [526.881285] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [526.881288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [526.881290] CR2: 0000652fc0bdba18 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [526.881292] PKRU: 55555554 <4> [526.881293] Call Trace: <4> [526.881295] <TASK> <4> [526.881303] ? drm_sched_job_timedout+0x80/0x1a0 [gpu_sched] <4> [526.881311] ? lock_release+0xce/0x280 <4> [526.881319] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [526.881328] process_one_work+0x22e/0x6b0 <4> [526.881339] worker_thread+0x1e8/0x3d0 <4> [526.881343] ? __pfx_worker_thread+0x10/0x10 <7> [526.881282] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [526.881347] kthread+0x11f/0x250 <4> [526.881351] ? __pfx_kthread+0x10/0x10 <4> [526.881356] ret_from_fork+0x344/0x3a0 <4> [526.881359] ? __pfx_kthread+0x10/0x10 <4> [526.881363] ret_from_fork_asm+0x1a/0x30 <4> [526.881373] </TASK> <4> [526.881375] irq event stamp: 708337 <4> [526.881376] hardirqs last enabled at (708343): [<ffffffff8149ead9>] __up_console_sem+0x79/0xa0 <4> [526.881380] hardirqs last disabled at (708348): [<ffffffff8149eabe>] __up_console_sem+0x5e/0xa0 <4> [526.881383] softirqs last enabled at (707440): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.881386] softirqs last disabled at (707423): [<ffffffff813c96ef>] __irq_exit_rcu+0x13f/0x160 <4> [526.881389] ---[ end trace 0000000000000000 ]--- <7> [526.883646] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:269:plane 1C] ddb ( 0 - 0) -> ( 0 - 1989), size 0 -> 1989 <7> [526.883740] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm <7> [526.883823] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 <7> [526.883900] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 <7> [526.883971] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 <7> [526.884054] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:385:pipe C] data rate 594000 num active planes 1 <7> [526.884152] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000 <7> [526.884245] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000 <7> [526.884337] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624 <7> [526.902146] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:269:plane 1C] ddb ( 0 - 1989) -> ( 0 - 123), size 1989 -> 123 <7> [526.902235] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] level wm0,wm1,wm2,wm3,wm4,wm5, wm6, wm7,twm,swm,stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm <7> [526.902314] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] lines 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0 <7> [526.902393] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] blocks 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 -> 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0 <7> [526.902466] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] min_ddb 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 -> 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 <7> [526.902550] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] No SAGV, use UINT_MAX as peak bw. <6> [528.902901] [IGT] kms_async_flips: finished subtest pipe-C-HDMI-A-3-4, SUCCESS

<7> [526.174522] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] level *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

<4> [526.186513] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.186867] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.208737] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.208879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.228116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.228300] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.234769] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.234912] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.254167] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.254304] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.274140] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.274275] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.276526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.276686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.296824] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.296971] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.316199] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.316339] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.321807] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.321939] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.341191] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.341327] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.360180] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.360317] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.363066] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath

<4> [526.363297] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.383189] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.383326] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.403193] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.403337] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.410040] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.410178] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.429477] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.429626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.449162] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.449299] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.451813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.451947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.471092] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.471282] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.490134] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.490273] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.495449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.495583] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.515205] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.515340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.535217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.535352] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.537810] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec

<4> [526.537825] rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [526.537953] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.557343] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.557484] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.577110] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.577246] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.583424] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.583561] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.603208] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.603342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.622167] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.622304] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.624608] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.624760] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.644177] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.644314] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.663110] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.663302] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.668743] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.668880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.688194] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.688331] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.708150] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.708285] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.710582] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.710719] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.730209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.730347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.749225] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.749364] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.755829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.755967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.775188] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.775323] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.794145] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.794282] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.797065] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.797204] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.816174] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.816312] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.835538] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.835688] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.842403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.842541] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.862301] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.862437] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<4> [526.881060] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart hid_generic coretemp spi_nor asus_nb_wmi mei_pxp mei_hdcp mtd asus_wmi sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec r8169 rapl video snd_hda_core intel_cstate snd_hwdep snd_pcm realtek snd_timer i2c_i801 mei_me snd spi_intel_pci i2c_mux binfmt_misc idma64 intel_pmc_core mei soundcore spi_intel i2c_smbus pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi pinctrl_alderlake intel_vsec acpi_pad acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [526.881270] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 72 1d 5a e1 48 89 c6 48 8d 3d 58 c2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 58 e9 0b ef ff ff 8b 70 08 49

<7> [526.883740] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm

<7> [526.902235] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:269:plane 1C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm

Results for igt@kms_async_flips@async-flip-with-page-flip-events-tiled@pipe-c-hdmi-a-3-4