igt@xe_exec_system_allocator@process-many-stride-malloc-prefetch on shard-bmg@xe-pw-161761v2 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-2
Igt-Version	IGT-Version: 2.3-g133491e99 (x86_64) (Linux: 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ x86_64)
Out	Using IGT_SRANDOM=1774281688 for randomisation Opened device: /dev/dri/card0 Starting subtest: process-many-stride-malloc-prefetch runner: This test was killed due to a kernel taint (0x244). This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: process-many-stride-malloc-prefetch Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [wait4+0x15] #3 [__igt_waitchildren+0x57] #4 [igt_waitchildren+0x2d] #5 [processes.part.0.constprop.0+0x1a6] #6 [__igt_unique____real_main2349+0x286f] #7 [main+0x2d] #8 [__libc_init_first+0x8a] #9 [__libc_start_main+0x8b] #10 [_start+0x25] Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3d] #3 [drmIoctl+0x30] #4 [___xe_vm_bind+0xf7] #5 [__xe_vm_bind+0x35] #6 [__xe_vm_bind_assert+0x32] #7 [xe_vm_prefetch_async+0x2b] #8 [test_exec+0x111b] #9 [processes.part.0.constprop.0+0x137] #10 [__igt_unique____real_Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3d] #3 [drmIoctl+m0axi3n02]3 49+0x286f] #11 [main+0x2d] # 4# 12[ [____l_ibxc_ei_nivt_mfi_rsbti+0nx8da+] 0xf7] #13 [__libc_start_main+0x8b] #14 [_start+0x25] #5 [__xe_vm_bind+0x35] #6 [__xe_vm_bind_assert+0x32] #7 [xe_vm_prefetch_async+0x2b] #8 [test_exec+0x111b] #9 [processes.part.0.constprop.0+0x137] #10 [__igt_unique____real_main2349+0x286f] #11 [main+0x2d] #12 [__libc_init_first+0x8a] #13 [__libc_start_main+0x8b] #14 [_start+0x25] Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3d] #3 [drmIoctl+0x30] #4 [___xe_vm_bind+0xf7] #5 [__xe_vm_bind+0x35] #6 [__xe_vm_bind_assert+0x32] #7 [xe_vm_prefetch_async+0x2b] #8 [test_exec+0x111b] #9 [processes.Received signal SIGQUIT. Stack trace: Received signal SIGQUIT. Stack trace: Received signal SIGQUIT. Received signal Stack trace: SIGQUIT. Stack trace: ##00 [[ffaattaall__ssiigg__hhaannddlleerr++00xx1 17#7 b0b#] ]0 [ f[aftaatla_ls_isgi_gh_ahnadnldelre+r0+x01x71b7]b ] ##11 [[____ssiiggaaccptt iaioro# ntn1+.#+ 0010[x. x_5c[5_0o_0s]n_] iss gtiapgcratocpit.oi0no++n00+xx015x3057]0] ] #10 [__igt_unique____real_main2349+0x286f] # 2# 2[ i[oicotclt+l0+x03 xd#3]2d ]#[ 2 i #o[1ci1to lc[+tm0lax+i30ndx+]3d] #03#x 32[ dd[]rd mrImoIcotclt+l0+x03x030]] # 3# 3[ d#[r1dm2rI mo[Ic_ot_cllt+il0b+xc03_x0i3]n0 i] t #_#4f4 i [r[_s__t__+_x0xxee8__avv]mm __bbiinndd++00xxff77]] #4 [#_4_ _[x_e___vx me#__1bv3im n_[db_+i_0nlx # 5if #db7[5c_]+ __ 0sx[xt_fea_7rx]_te __vmvammi__nbb+ii0nxdn8+db0+]x0 3x5]3 5] #14 [_start+0x25] #5 [__x e#_5v m[__b_ixned_+v0mx_3b5i]n d+#06x3 5[] __xe_vm_bind_ass er#t6+ 0[x_3_2x]e _vm_bind_assert+0x32] #6 [ #_ #_7#6x e7[[__ xv_[mex__exbv_imven_mdp__rb_aeisfvnsedem_tractsh+_s_0eaxrps3ty2+n]r0c x+e302xf2]b ]e tch_async+0x2b] #8 [test_exec+0x111b] #9 [processes . ##7p7 a [r[xtxe. e__0#vv.mmc8__o ppnrrs[eetftfpeeertsctothc_p_he.a_x0sae+ysc0ny+xcn01+cx301+7x10]21x bb2]]b ] #1 0 ## #98[8 _ [[_[ptitregeostsct_te_u_senesxixeeqescuc.+e+p0_0ax_xr11_t11_.11r0bbe.]c]a o nls_tmparionp2.304+9+00xx123876]f ] ##99 [[pprroocceessss # e1e0#ss 1..[1pp_ aa_[rrimttga..ti00_n..u+ccn0ooixnnq2ssudtte]pp_r r_oo_pp_..r00e++a00lxx_11m33a77i]]n 2349+0x286f] ##1100 [[____iiggtt__u un#ni1iq1qu ue[e_m__a__i__n_r+re0eaxa2lld__]mm aaiinn22334499++00xx2 #12 #[28_1_862l6f if][b] _c __liinbict__ifniristt_+f0ixr8sat]+ 0x8a] ##1111 [[mmaiani+n0+x02xd2]d ] #13 [_ _l#i1b3c _[s_t_alritb_cm_asitn a+ #r0#1tx12_82 mb[ a]_[i __nl_+il0bixcb8_cb_i]in niitt__ffiirrsstt++00xx88a #1 4a]# ]1[ _ 4s t[a_rstt+a0rxt2+50]x 25] # 1#31 3[ _[__l_ilbicb_cs_tsatratr_tm_amiani+n0+x08xb8]b ] # 1#41 4[_ s[t_asrtta+r0tx+205x]2 5]
Dmesg Scroll to first warning	<6> [377.156838] Console: switching to colour dummy device 80x25 <6> [377.157159] [IGT] xe_exec_system_allocator: executing <6> [377.167320] [IGT] xe_exec_system_allocator: starting subtest process-many-stride-malloc-prefetch <7> [377.170680] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module. <7> [377.213565] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.214375] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.214503] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.214742] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.214797] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215091] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215265] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215314] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215493] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215528] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215584] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215755] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.215934] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.216038] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.216039] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.216460] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.216489] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.216491] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [377.217121] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.217215] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.217240] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [377.217780] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [377.218613] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.220160] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.220699] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [377.223896] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [379.772267] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x30312d2e <7> [379.772659] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x30303030 <4> [382.617348] xe 0000:03:00.0: [drm] Tile0: GT0: Check job timeout: seqno=87067, lrc_seqno=87067, guc_id=0, not started <4> [387.739332] xe 0000:03:00.0: [drm] Tile0: GT0: Check job timeout: seqno=87067, lrc_seqno=87067, guc_id=0, not started <4> [392.861405] xe 0000:03:00.0: [drm] Tile0: GT0: Check job timeout: seqno=87067, lrc_seqno=87067, guc_id=0, not started <6> [392.974368] pcieport 0000:00:06.0: AER: Multiple Correctable error message received from 0000:05:00.0 <4> [392.974394] nvme 0000:05:00.0: PCIe Bus Error: severity=Correctable, type=Physical Layer, (Receiver ID) <4> [392.974403] nvme 0000:05:00.0: device [15b7:5017] error status/mask=00000001/0000e000 <4> [392.974412] nvme 0000:05:00.0: [ 0] RxErr (First) <6> [393.502197] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x209 <5> [393.502824] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87067, lrc_seqno=87067, guc_id=0, flags=0x73 in no process [-1] <7> [393.502849] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.503239] ------------[ cut here ]------------ <4> [393.503246] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.503253] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.503749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.504087] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.504117] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.504132] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [393.504139] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.504147] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.504176] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.504615] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.504625] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.504637] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.504645] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.504652] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.504659] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.504665] R13: ffff8881017b6490 R14: ffff888135fe0000 R15: 00000000ffffffc2 <4> [393.504673] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.504682] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.504690] CR2: 000000062b4ee2a0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.504698] PKRU: 55555554 <4> [393.504705] Call Trace: <4> [393.504711] <TASK> <4> [393.504733] ? lock_acquire+0x20/0x2f0 <4> [393.504765] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [393.504792] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.504822] process_one_work+0x239/0x760 <4> [393.504854] worker_thread+0x200/0x3f0 <4> [393.504868] ? __pfx_worker_thread+0x10/0x10 <4> [393.504880] kthread+0x10d/0x150 <4> [393.504896] ? __pfx_kthread+0x10/0x10 <4> [393.504915] ret_from_fork+0x3d4/0x480 <4> [393.504927] ? __pfx_kthread+0x10/0x10 <4> [393.504945] ret_from_fork_asm+0x1a/0x30 <4> [393.504984] </TASK> <4> [393.504990] irq event stamp: 223721 <4> [393.504996] hardirqs last enabled at (223727): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.505012] hardirqs last disabled at (223732): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.505023] softirqs last enabled at (223560): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.505037] softirqs last disabled at (223555): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.505048] ---[ end trace 0000000000000000 ]--- <7> [393.506735] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.506739] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.506791] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.506794] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.506945] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.507129] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.507136] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <5> [393.507712] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87079, lrc_seqno=87079, guc_id=0, flags=0x73 in no process [-1] <7> [393.507727] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.508031] ------------[ cut here ]------------ <4> [393.508036] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.508042] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.508403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.508722] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.508726] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.508729] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.508730] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.508731] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.508736] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.508799] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.508800] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.508802] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.508803] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.508804] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.508805] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.508806] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.508807] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.508808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.508809] CR2: 000000062b4ee2a0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.508811] PKRU: 55555554 <4> [393.508811] Call Trace: <4> [393.508812] <TASK> <4> [393.508816] ? lock_acquire+0x20/0x2f0 <4> [393.508820] ? lock_release+0xd0/0x2b0 <4> [393.508825] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.508829] process_one_work+0x239/0x760 <4> [393.508835] worker_thread+0x200/0x3f0 <4> [393.508837] ? __pfx_worker_thread+0x10/0x10 <4> [393.508839] kthread+0x10d/0x150 <4> [393.508841] ? __pfx_kthread+0x10/0x10 <4> [393.508844] ret_from_fork+0x3d4/0x480 <4> [393.508846] ? __pfx_kthread+0x10/0x10 <4> [393.508849] ret_from_fork_asm+0x1a/0x30 <4> [393.508855] </TASK> <4> [393.508856] irq event stamp: 225091 <4> [393.508857] hardirqs last enabled at (225097): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.508859] hardirqs last disabled at (225102): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.508861] softirqs last enabled at (223560): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.508863] softirqs last disabled at (223555): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.508864] ---[ end trace 0000000000000000 ]--- <6> [393.508866] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.508928] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.508966] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.509075] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.509574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.509659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.509744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.509822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.509898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.509976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.510056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.510134] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.510227] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.510339] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.511480] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.522243] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.522506] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.523896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.523977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.524052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.524125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.524197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.524267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.524339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.524419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.524496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.524571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.524648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.524725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.524799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.524873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.524947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.525020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.525092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.525166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.525239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.525324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.525405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.525498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.525579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.525656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.525732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.525808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.525883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.525962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.526041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.526116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.526193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.526270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.526352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.526436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.526520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.526599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.526677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.526755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.526831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.526907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.526985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.527061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.527137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.527210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.527290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.527365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.527446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.527520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.527595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.527668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.527743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.527820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.527896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.527972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.528045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.528121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.528193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.528269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.528349] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.528890] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.528896] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87079, lrc_seqno=87079, guc_id=0, flags=0x73 in no process [-1] <7> [393.528899] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.528964] ------------[ cut here ]------------ <4> [393.528965] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.528966] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.529045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.529104] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.529109] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.529111] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.529113] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.529114] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.529119] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.529193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.529194] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.529197] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.529198] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.529199] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.529200] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.529201] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.529203] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.529204] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.529205] CR2: 000000062b4ee2a0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.529207] PKRU: 55555554 <4> [393.529208] Call Trace: <4> [393.529209] <TASK> <4> [393.529213] ? lock_acquire+0x20/0x2f0 <4> [393.529218] ? lock_release+0xd0/0x2b0 <4> [393.529224] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.529229] process_one_work+0x239/0x760 <4> [393.529235] worker_thread+0x200/0x3f0 <4> [393.529238] ? __pfx_worker_thread+0x10/0x10 <4> [393.529240] kthread+0x10d/0x150 <4> [393.529243] ? __pfx_kthread+0x10/0x10 <4> [393.529246] ret_from_fork+0x3d4/0x480 <4> [393.529248] ? __pfx_kthread+0x10/0x10 <4> [393.529251] ret_from_fork_asm+0x1a/0x30 <4> [393.529258] </TASK> <4> [393.529259] irq event stamp: 228381 <4> [393.529260] hardirqs last enabled at (228387): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.529263] hardirqs last disabled at (228392): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.529265] softirqs last enabled at (227194): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.529267] softirqs last disabled at (227189): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.529269] ---[ end trace 0000000000000000 ]--- <6> [393.529271] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.529343] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.529349] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.529892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.530110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.530204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.530299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.530389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.530485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.530571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.530656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.530737] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.530834] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.530952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.531975] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.542685] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.542929] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.543964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.544039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.544109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.544181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.544252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.544322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.544393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.544473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.544548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.544622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.544695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.544766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.544840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.544914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.544988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.545059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.545131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.545202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.545274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.545357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.545442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.545522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.545600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.545677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.545754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.545829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.545904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.545981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.546058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.546133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.546210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.546287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.546369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.546455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.546539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.546616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.546693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.546769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.546844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.546916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.546994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.547071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.547146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.547222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.547302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.547378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.547462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.547535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.547611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.547686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.547762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.547841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.547915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.547991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.548064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.548140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.548213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.548288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.548365] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.548655] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.548660] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87079, lrc_seqno=87079, guc_id=0, flags=0x73 in no process [-1] <7> [393.548662] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.548729] ------------[ cut here ]------------ <4> [393.548730] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.548731] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.548809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.548867] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.548872] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.548874] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.548876] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.548877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.548882] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.548955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.548957] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.548959] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.548960] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.548961] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.548962] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.548963] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.548965] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.548966] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.548967] CR2: 000000062b4ee2a0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.548969] PKRU: 55555554 <4> [393.548970] Call Trace: <4> [393.548971] <TASK> <4> [393.548975] ? lock_acquire+0x20/0x2f0 <4> [393.548980] ? lock_release+0xd0/0x2b0 <4> [393.548985] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.548991] process_one_work+0x239/0x760 <4> [393.548997] worker_thread+0x200/0x3f0 <4> [393.548999] ? __pfx_worker_thread+0x10/0x10 <4> [393.549001] kthread+0x10d/0x150 <4> [393.549004] ? __pfx_kthread+0x10/0x10 <4> [393.549008] ret_from_fork+0x3d4/0x480 <4> [393.549009] ? __pfx_kthread+0x10/0x10 <4> [393.549012] ret_from_fork_asm+0x1a/0x30 <4> [393.549020] </TASK> <4> [393.549021] irq event stamp: 231705 <4> [393.549022] hardirqs last enabled at (231711): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.549024] hardirqs last disabled at (231716): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.549026] softirqs last enabled at (230706): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.549029] softirqs last disabled at (230701): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.549031] ---[ end trace 0000000000000000 ]--- <7> [393.549239] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.549276] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.549314] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.549353] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.549560] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.549564] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.549579] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <5> [393.550328] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87093, lrc_seqno=87093, guc_id=0, flags=0x73 in no process [-1] <7> [393.550331] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.550395] ------------[ cut here ]------------ <4> [393.550396] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.550397] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.550480] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.550539] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.550543] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.550546] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.550547] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.550548] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.550553] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.550619] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.550621] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.550623] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.550624] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.550625] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.550626] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.550627] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.550629] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.550630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.550631] CR2: 000000062b4ee2a0 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.550632] PKRU: 55555554 <4> [393.550633] Call Trace: <4> [393.550634] <TASK> <4> [393.550638] ? lock_acquire+0x20/0x2f0 <4> [393.550643] ? lock_release+0xd0/0x2b0 <4> [393.550648] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.550654] process_one_work+0x239/0x760 <4> [393.550660] worker_thread+0x200/0x3f0 <4> [393.550663] ? __pfx_worker_thread+0x10/0x10 <4> [393.550665] kthread+0x10d/0x150 <4> [393.550667] ? __pfx_kthread+0x10/0x10 <4> [393.550671] ret_from_fork+0x3d4/0x480 <4> [393.550673] ? __pfx_kthread+0x10/0x10 <4> [393.550676] ret_from_fork_asm+0x1a/0x30 <4> [393.550683] </TASK> <4> [393.550684] irq event stamp: 232941 <4> [393.550685] hardirqs last enabled at (232947): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.550688] hardirqs last disabled at (232952): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.550690] softirqs last enabled at (232192): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.550692] softirqs last disabled at (232187): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.550695] ---[ end trace 0000000000000000 ]--- <7> [393.550709] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.550816] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [393.550912] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.550981] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.550987] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.551393] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.551620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.551709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.551799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.551883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.551964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.552043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.552123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.552200] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.552292] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.552401] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.553417] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.563439] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.563689] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.564709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.564789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.564863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.564935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.565005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.565075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.565147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.565218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.565290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.565362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.565440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.565510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.565580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.565649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.565719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.565788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.565858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.565928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.565999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.566079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.566157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.566231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.566305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.566377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.566457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.566530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.566601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.566674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.566747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.566822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.566897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.566972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.567051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.567130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.567208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.567281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.567354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.567423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.567507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.567580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.567655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.567728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.567801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.567875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.567952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.568024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.568095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.568166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.568238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.568308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.568377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.568452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.568523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.568596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.568666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.568737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.568805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.568875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.568947] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.569094] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.569098] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87093, lrc_seqno=87093, guc_id=0, flags=0x73 in no process [-1] <7> [393.569101] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.569159] ------------[ cut here ]------------ <4> [393.569160] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.569162] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.569231] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.569291] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.569295] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.569298] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.569299] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.569300] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.569305] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.569375] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.569376] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.569379] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.569380] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.569381] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.569382] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.569383] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.569384] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.569386] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.569387] CR2: 000000062b4ee2a0 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [393.569389] PKRU: 55555554 <4> [393.569390] Call Trace: <4> [393.569391] <TASK> <4> [393.569394] ? lock_acquire+0x20/0x2f0 <4> [393.569400] ? lock_release+0xd0/0x2b0 <4> [393.569405] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.569411] process_one_work+0x239/0x760 <4> [393.569417] worker_thread+0x200/0x3f0 <4> [393.569419] ? __pfx_worker_thread+0x10/0x10 <4> [393.569422] kthread+0x10d/0x150 <4> [393.569424] ? __pfx_kthread+0x10/0x10 <4> [393.569428] ret_from_fork+0x3d4/0x480 <4> [393.569430] ? __pfx_kthread+0x10/0x10 <4> [393.569436] ret_from_fork_asm+0x1a/0x30 <4> [393.569444] </TASK> <4> [393.569445] irq event stamp: 236273 <4> [393.569446] hardirqs last enabled at (236279): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.569449] hardirqs last disabled at (236284): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.569451] softirqs last enabled at (235104): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.569453] softirqs last disabled at (235095): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.569456] ---[ end trace 0000000000000000 ]--- <6> [393.570382] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.570464] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.570477] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.570564] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.570668] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.571097] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.571319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.571410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.571511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.571596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.571679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.571760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.571841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.571919] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.572011] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.572125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.573131] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.583447] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.583696] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.584773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.584851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.584924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.584998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.585070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.585142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.585214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.585285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.585355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.585424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.585504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.585574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.585644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.585714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.585784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.585854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.585925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.585995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.586062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.586140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.586217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.586291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.586364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.586434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.586517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.586587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.586657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.586728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.586801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.586873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.586945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.587016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.587092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.587167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.587243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.587316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.587388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.587470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.587541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.587610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.587687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.587757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.587828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.587897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.587971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.588040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.588110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.588180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.588251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.588320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.588389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.588465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.588536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.588606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.588676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.588747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.588814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.588882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.588954] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.589106] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.589111] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87093, lrc_seqno=87093, guc_id=0, flags=0x73 in no process [-1] <7> [393.589113] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.589171] ------------[ cut here ]------------ <4> [393.589173] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.589174] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.589244] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.589306] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.589311] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.589314] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.589315] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.589316] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.589322] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.589390] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.589391] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.589394] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.589395] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.589396] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.589397] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.589398] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.589400] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.589401] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.589402] CR2: 000000062b4ee2a0 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [393.589404] PKRU: 55555554 <4> [393.589405] Call Trace: <4> [393.589406] <TASK> <4> [393.589410] ? lock_acquire+0x20/0x2f0 <4> [393.589416] ? lock_release+0xd0/0x2b0 <4> [393.589421] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.589426] process_one_work+0x239/0x760 <4> [393.589433] worker_thread+0x200/0x3f0 <4> [393.589435] ? __pfx_worker_thread+0x10/0x10 <4> [393.589438] kthread+0x10d/0x150 <4> [393.589443] ? __pfx_kthread+0x10/0x10 <4> [393.589447] ret_from_fork+0x3d4/0x480 <4> [393.589449] ? __pfx_kthread+0x10/0x10 <4> [393.589453] ret_from_fork_asm+0x1a/0x30 <4> [393.589460] </TASK> <4> [393.589461] irq event stamp: 239645 <4> [393.589462] hardirqs last enabled at (239651): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.589465] hardirqs last disabled at (239656): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.589467] softirqs last enabled at (238676): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.589470] softirqs last disabled at (238669): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.589472] ---[ end trace 0000000000000000 ]--- <7> [393.590092] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.590126] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.590192] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.590198] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.590215] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.590286] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.590301] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [393.590648] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87107, lrc_seqno=87107, guc_id=0, flags=0x73 in no process [-1] <7> [393.590656] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.590770] ------------[ cut here ]------------ <4> [393.590773] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.590775] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:42/3607 <4> [393.590852] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.590919] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.590924] CPU: 11 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.590928] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.590929] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.590930] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [393.590900] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [393.590935] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.591007] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.591008] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.591010] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.591012] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.591013] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.591014] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.591015] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.591016] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [393.591018] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.591019] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [393.591020] PKRU: 55555554 <4> [393.591022] Call Trace: <4> [393.591023] <TASK> <4> [393.591027] ? lock_acquire+0x20/0x2f0 <4> [393.591032] ? lock_release+0xd0/0x2b0 <4> [393.591037] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.591043] process_one_work+0x239/0x760 <4> [393.591049] worker_thread+0x200/0x3f0 <4> [393.591052] ? __pfx_worker_thread+0x10/0x10 <4> [393.591054] kthread+0x10d/0x150 <7> [393.591009] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [393.591057] ? __pfx_kthread+0x10/0x10 <4> [393.591060] ret_from_fork+0x3d4/0x480 <4> [393.591062] ? __pfx_kthread+0x10/0x10 <4> [393.591065] ret_from_fork_asm+0x1a/0x30 <4> [393.591072] </TASK> <4> [393.591073] irq event stamp: 384017 <4> [393.591074] hardirqs last enabled at (384023): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.591076] hardirqs last disabled at (384028): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.591078] softirqs last enabled at (380164): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.591080] softirqs last disabled at (380159): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.591082] ---[ end trace 0000000000000000 ]--- <6> [393.591084] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.591155] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.591161] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.591566] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.591782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.591870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.591960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.592045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.592128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.592211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.592294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.592373] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.592471] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.592583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.593592] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.603456] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.603706] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.604707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.604784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.604857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.604928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.605001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.605075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.605146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.605217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.605288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.605360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.605431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.605514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.605585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.605656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.605726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.605796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.605864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.605935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.606004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.606084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.606160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.606234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.606309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.606381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.606453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.606524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.606595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.606668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.606743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.606815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.606888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.606960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.607038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.607116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.607193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.607268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.607342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.607412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.607489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.607559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.607632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.607703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.607773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.607843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.607916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.607985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.608054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.608123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.608195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.608262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.608332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.608404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.608488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.608559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.608630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.608702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.608771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.608841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.608913] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.609057] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.609061] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87107, lrc_seqno=87107, guc_id=0, flags=0x73 in no process [-1] <7> [393.609063] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.609121] ------------[ cut here ]------------ <4> [393.609122] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.609124] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:63/3628 <4> [393.609194] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.609252] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.609257] CPU: 6 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.609260] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.609261] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.609262] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.609267] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.609335] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.609336] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.609338] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.609340] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.609341] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.609342] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.609343] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.609344] FS: 0000000000000000(0000) GS:ffff8888daf98000(0000) knlGS:0000000000000000 <4> [393.609346] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.609347] CR2: 000000062b4ee2a0 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [393.609348] PKRU: 55555554 <4> [393.609349] Call Trace: <4> [393.609350] <TASK> <4> [393.609354] ? lock_acquire+0x20/0x2f0 <4> [393.609360] ? lock_release+0xd0/0x2b0 <4> [393.609365] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.609370] process_one_work+0x239/0x760 <4> [393.609376] worker_thread+0x200/0x3f0 <4> [393.609379] ? __pfx_worker_thread+0x10/0x10 <4> [393.609381] kthread+0x10d/0x150 <4> [393.609384] ? __pfx_kthread+0x10/0x10 <4> [393.609387] ret_from_fork+0x3d4/0x480 <4> [393.609389] ? __pfx_kthread+0x10/0x10 <4> [393.609392] ret_from_fork_asm+0x1a/0x30 <4> [393.609399] </TASK> <4> [393.609400] irq event stamp: 243379 <4> [393.609401] hardirqs last enabled at (243385): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.609404] hardirqs last disabled at (243390): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.609406] softirqs last enabled at (242420): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.609408] softirqs last disabled at (242385): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.609410] ---[ end trace 0000000000000000 ]--- <6> [393.609412] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.609489] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.609495] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.610762] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.610868] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.610970] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.611192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.611284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.611378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.611472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.611558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.611640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.611723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.611801] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.611895] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.612008] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.613019] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.623464] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.623713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.624669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.624746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.624819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.624892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.624965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.625036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.625107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.625177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.625246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.625317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.625387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.625463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.625536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.625607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.625679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.625750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.625819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.625889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.625959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.626037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.626114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.626189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.626264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.626339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.626410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.626490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.626561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.626638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.626715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.626789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.626864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.626938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.627015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.627094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.627172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.627247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.627321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.627392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.627467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.627541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.627616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.627689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.627761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.627832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.627906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.627977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.628045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.628114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.628184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.628251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.628320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.628392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.628473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.628545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.628615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.628685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.628753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.628822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.628893] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.629042] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.629046] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87107, lrc_seqno=87107, guc_id=0, flags=0x73 in no process [-1] <7> [393.629049] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.629108] ------------[ cut here ]------------ <4> [393.629109] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.629110] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:45/3610 <4> [393.629181] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.629241] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.629246] CPU: 10 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.629249] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.629250] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.629252] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.629257] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.629326] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.629327] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [393.629330] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.629331] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.629333] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.629334] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.629335] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.629337] FS: 0000000000000000(0000) GS:ffff8888db198000(0000) knlGS:0000000000000000 <4> [393.629339] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.629340] CR2: 000000062b4df000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [393.629342] PKRU: 55555554 <4> [393.629343] Call Trace: <4> [393.629344] <TASK> <4> [393.629349] ? lock_acquire+0x20/0x2f0 <4> [393.629355] ? lock_release+0xd0/0x2b0 <4> [393.629360] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.629366] process_one_work+0x239/0x760 <4> [393.629372] worker_thread+0x200/0x3f0 <4> [393.629375] ? __pfx_worker_thread+0x10/0x10 <4> [393.629377] kthread+0x10d/0x150 <4> [393.629380] ? __pfx_kthread+0x10/0x10 <4> [393.629384] ret_from_fork+0x3d4/0x480 <4> [393.629386] ? __pfx_kthread+0x10/0x10 <4> [393.629389] ret_from_fork_asm+0x1a/0x30 <4> [393.629396] </TASK> <4> [393.629398] irq event stamp: 560031 <4> [393.629399] hardirqs last enabled at (560037): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.629402] hardirqs last disabled at (560042): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.629404] softirqs last enabled at (559072): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.629406] softirqs last disabled at (559047): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.629409] ---[ end trace 0000000000000000 ]--- <7> [393.630015] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.630016] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.630022] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.630133] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.630133] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.630207] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.630231] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [393.630724] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87121, lrc_seqno=87121, guc_id=0, flags=0x73 in no process [-1] <7> [393.630728] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.630805] ------------[ cut here ]------------ <4> [393.630806] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.630809] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:42/3607 <7> [393.630797] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [393.630927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 <7> [393.630953] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [393.631021] intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.631039] CPU: 11 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.631042] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.631043] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.631045] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.631052] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.631140] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.631142] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.631144] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.631145] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.631146] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.631147] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.631148] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.631150] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [393.631151] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.631152] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [393.631154] PKRU: 55555554 <4> [393.631155] Call Trace: <4> [393.631156] <TASK> <4> [393.631160] ? lock_acquire+0x20/0x2f0 <4> [393.631165] ? lock_release+0xd0/0x2b0 <4> [393.631170] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.631176] process_one_work+0x239/0x760 <4> [393.631182] worker_thread+0x200/0x3f0 <4> [393.631185] ? __pfx_worker_thread+0x10/0x10 <4> [393.631187] kthread+0x10d/0x150 <4> [393.631190] ? __pfx_kthread+0x10/0x10 <4> [393.631193] ret_from_fork+0x3d4/0x480 <4> [393.631195] ? __pfx_kthread+0x10/0x10 <4> [393.631198] ret_from_fork_asm+0x1a/0x30 <4> [393.631205] </TASK> <4> [393.631206] irq event stamp: 385805 <4> [393.631207] hardirqs last enabled at (385811): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.631209] hardirqs last disabled at (385816): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.631211] softirqs last enabled at (384804): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [393.631213] softirqs last disabled at (384802): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [393.631216] ---[ end trace 0000000000000000 ]--- <6> [393.631217] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.631288] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.631295] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.631705] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.631921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.632009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.632099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.632183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.632265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.632345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.632425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.632515] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.632608] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.632720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.633741] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.643473] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.643722] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.644745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.644823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.644897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.644971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.645042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.645113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.645186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.645258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.645330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.645401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.645477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.645548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.645616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.645685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.645754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.645824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.645893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.645959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.646027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.646105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.646183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.646257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.646333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.646403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.646486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.646558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.646629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.646704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.646780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.646853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.646927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.647001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.647079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.647157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.647235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.647310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.647383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.647454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.647543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.647636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.647712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.647786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.647860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.647932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.648007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.648084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.648170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.648252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.648323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.648392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.648464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.648561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.648648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.648721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.648792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.648864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.648933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.649003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.649076] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.649226] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.649230] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87121, lrc_seqno=87121, guc_id=0, flags=0x73 in no process [-1] <7> [393.649233] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.649292] ------------[ cut here ]------------ <4> [393.649293] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.649295] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:42/3607 <4> [393.649365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.649424] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.649429] CPU: 11 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.649432] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.649433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.649435] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.649440] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.649522] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.649525] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.649528] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.649531] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.649533] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.649535] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.649537] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.649539] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [393.649542] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.649544] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [393.649547] PKRU: 55555554 <4> [393.649549] Call Trace: <4> [393.649551] <TASK> <4> [393.649557] ? lock_acquire+0x20/0x2f0 <4> [393.649566] ? lock_release+0xd0/0x2b0 <4> [393.649575] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.649584] process_one_work+0x239/0x760 <4> [393.649595] worker_thread+0x200/0x3f0 <4> [393.649600] ? __pfx_worker_thread+0x10/0x10 <4> [393.649604] kthread+0x10d/0x150 <4> [393.649608] ? __pfx_kthread+0x10/0x10 <4> [393.649614] ret_from_fork+0x3d4/0x480 <4> [393.649617] ? __pfx_kthread+0x10/0x10 <4> [393.649622] ret_from_fork_asm+0x1a/0x30 <4> [393.649635] </TASK> <4> [393.649637] irq event stamp: 389131 <4> [393.649639] hardirqs last enabled at (389137): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.649643] hardirqs last disabled at (389142): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.649646] softirqs last enabled at (388970): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.649650] softirqs last disabled at (388965): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.649653] ---[ end trace 0000000000000000 ]--- <6> [393.649656] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.649732] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.649738] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.650273] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.650493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.650582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.650667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.650747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.650826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.650904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.650983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.651059] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.651151] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.651262] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.652273] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.662830] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.663079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.664088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.664166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.664238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.664313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.664387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.664459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.664547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.664627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.664699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.664770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.664839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.664907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.664978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.665047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.665116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.665184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.665254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.665324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.665394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.665477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.665569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.665644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.665719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.665791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.665862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.665934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.666004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.666077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.666151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.666224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.666296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.666368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.666445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.666539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.666628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.666703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.666777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.666848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.666919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.666988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.667060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.667132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.667202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.667272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.667346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.667416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.667496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.667579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.667652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.667721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.667789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.667861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.667932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.668002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.668073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.668147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.668217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.668286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.668358] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.668512] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.668518] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87121, lrc_seqno=87121, guc_id=0, flags=0x73 in no process [-1] <7> [393.668522] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.668588] ------------[ cut here ]------------ <4> [393.668589] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.668591] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:42/3607 <4> [393.668662] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.668720] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.668725] CPU: 11 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.668727] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.668729] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.668730] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.668735] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.668803] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.668805] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.668807] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.668808] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.668809] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.668810] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.668812] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.668813] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [393.668814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.668816] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [393.668817] PKRU: 55555554 <4> [393.668818] Call Trace: <4> [393.668819] <TASK> <4> [393.668823] ? lock_acquire+0x20/0x2f0 <4> [393.668828] ? lock_release+0xd0/0x2b0 <4> [393.668833] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.668839] process_one_work+0x239/0x760 <4> [393.668845] worker_thread+0x200/0x3f0 <4> [393.668847] ? __pfx_worker_thread+0x10/0x10 <4> [393.668850] kthread+0x10d/0x150 <4> [393.668852] ? __pfx_kthread+0x10/0x10 <4> [393.668856] ret_from_fork+0x3d4/0x480 <4> [393.668857] ? __pfx_kthread+0x10/0x10 <4> [393.668861] ret_from_fork_asm+0x1a/0x30 <4> [393.668868] </TASK> <4> [393.668869] irq event stamp: 392463 <4> [393.668870] hardirqs last enabled at (392469): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.668872] hardirqs last disabled at (392474): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.668874] softirqs last enabled at (391464): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.668876] softirqs last disabled at (391457): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.668878] ---[ end trace 0000000000000000 ]--- <7> [393.669381] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.669445] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.669468] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.669578] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.669588] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.669621] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.669639] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [393.670163] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87135, lrc_seqno=87135, guc_id=0, flags=0x73 in no process [-1] <7> [393.670166] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.670230] ------------[ cut here ]------------ <4> [393.670232] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.670233] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:42/3607 <4> [393.670305] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.670362] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.670367] CPU: 11 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.670370] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.670371] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.670372] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.670377] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.670444] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.670446] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.670447] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.670449] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.670450] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.670451] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.670452] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.670453] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [393.670454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.670456] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [393.670457] PKRU: 55555554 <4> [393.670458] Call Trace: <4> [393.670459] <TASK> <4> [393.670463] ? lock_acquire+0x20/0x2f0 <4> [393.670468] ? lock_release+0xd0/0x2b0 <4> [393.670473] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.670486] process_one_work+0x239/0x760 <4> [393.670496] worker_thread+0x200/0x3f0 <4> [393.670501] ? __pfx_worker_thread+0x10/0x10 <4> [393.670505] kthread+0x10d/0x150 <4> [393.670509] ? __pfx_kthread+0x10/0x10 <4> [393.670515] ret_from_fork+0x3d4/0x480 <4> [393.670518] ? __pfx_kthread+0x10/0x10 <4> [393.670522] ret_from_fork_asm+0x1a/0x30 <4> [393.670535] </TASK> <4> [393.670537] irq event stamp: 393813 <4> [393.670539] hardirqs last enabled at (393819): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.670543] hardirqs last disabled at (393824): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.670547] softirqs last enabled at (391464): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.670550] softirqs last disabled at (391457): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.670553] ---[ end trace 0000000000000000 ]--- <6> [393.670564] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [393.670581] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [393.670645] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.670653] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.670684] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.671058] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.671275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.671365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.671457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.671557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.671639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.671719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.671799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.671876] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.671970] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.672080] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.673091] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.683489] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.683739] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.684754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.684831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.684905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.684980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.685053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.685127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.685198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.685271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.685343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.685413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.685487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.685556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.685626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.685694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.685762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.685829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.685898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.685966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.686036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.686115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.686191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.686266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.686340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.686411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.686491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.686563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.686635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.686709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.686786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.686861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.686934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.687007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.687084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.687161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.687239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.687311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.687385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.687455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.687540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.687611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.687685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.687755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.687825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.687894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.687967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.688036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.688106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.688175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.688244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.688312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.688381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.688457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.688540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.688611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.688681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.688751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.688821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.688890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.688963] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.689109] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.689114] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87135, lrc_seqno=87135, guc_id=0, flags=0x73 in no process [-1] <7> [393.689116] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.689174] ------------[ cut here ]------------ <4> [393.689176] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.689177] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:42/3607 <4> [393.689248] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.689309] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.689315] CPU: 2 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.689317] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.689319] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.689320] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.689325] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.689393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.689395] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.689397] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.689398] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.689399] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.689401] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.689402] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.689403] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [393.689404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.689406] CR2: 00007d9f251a804c CR3: 0000000170185002 CR4: 0000000000f72ef0 <4> [393.689407] PKRU: 55555554 <4> [393.689408] Call Trace: <4> [393.689409] <TASK> <4> [393.689413] ? lock_acquire+0x20/0x2f0 <4> [393.689419] ? lock_release+0xd0/0x2b0 <4> [393.689424] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.689429] process_one_work+0x239/0x760 <4> [393.689435] worker_thread+0x200/0x3f0 <4> [393.689438] ? __pfx_worker_thread+0x10/0x10 <4> [393.689440] kthread+0x10d/0x150 <4> [393.689443] ? __pfx_kthread+0x10/0x10 <4> [393.689446] ret_from_fork+0x3d4/0x480 <4> [393.689448] ? __pfx_kthread+0x10/0x10 <4> [393.689451] ret_from_fork_asm+0x1a/0x30 <4> [393.689458] </TASK> <4> [393.689459] irq event stamp: 397129 <4> [393.689460] hardirqs last enabled at (397135): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.689463] hardirqs last disabled at (397140): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.689465] softirqs last enabled at (395962): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.689467] softirqs last disabled at (395957): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.689470] ---[ end trace 0000000000000000 ]--- <6> [393.689471] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.689566] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.689574] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.689983] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.690195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.690278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.690363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.690444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.690538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.690617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.690696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.690771] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.690863] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.690973] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.691981] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.702496] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.702749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.703784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.703863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.703938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.704012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.704085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.704156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.704228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.704300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.704370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.704441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.704523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.704596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.704667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.704739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.704809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.704880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.704950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.705020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.705089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.705168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.705245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.705319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.705394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.705466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.705547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.705616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.705687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.705761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.705835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.705907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.705981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.706056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.706137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.706217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.706294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.706367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.706441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.706571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.706642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.706712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.706783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.706854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.706922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.706991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.707063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.707132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.707201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.707270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.707340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.707408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.707476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.707579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.707650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.707720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.707788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.707857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.707927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.707994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.708064] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.708219] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.708223] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87135, lrc_seqno=87135, guc_id=0, flags=0x73 in no process [-1] <7> [393.708225] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.708283] ------------[ cut here ]------------ <4> [393.708284] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.708285] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:42/3607 <4> [393.708357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.708414] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.708419] CPU: 2 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.708422] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.708423] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.708424] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.708429] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.708502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.708503] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.708506] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.708507] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.708508] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.708510] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.708511] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.708512] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [393.708514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.708515] CR2: 00007d9f251a804c CR3: 0000000170185002 CR4: 0000000000f72ef0 <4> [393.708517] PKRU: 55555554 <4> [393.708518] Call Trace: <4> [393.708519] <TASK> <4> [393.708523] ? lock_acquire+0x20/0x2f0 <4> [393.708528] ? lock_release+0xd0/0x2b0 <4> [393.708533] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.708539] process_one_work+0x239/0x760 <4> [393.708544] worker_thread+0x200/0x3f0 <4> [393.708547] ? __pfx_worker_thread+0x10/0x10 <4> [393.708549] kthread+0x10d/0x150 <4> [393.708552] ? __pfx_kthread+0x10/0x10 <4> [393.708555] ret_from_fork+0x3d4/0x480 <4> [393.708557] ? __pfx_kthread+0x10/0x10 <4> [393.708560] ret_from_fork_asm+0x1a/0x30 <4> [393.708567] </TASK> <4> [393.708568] irq event stamp: 400861 <4> [393.708570] hardirqs last enabled at (400867): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.708572] hardirqs last disabled at (400872): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.708574] softirqs last enabled at (399888): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.708577] softirqs last disabled at (399855): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.708579] ---[ end trace 0000000000000000 ]--- <5> [393.709100] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87149, lrc_seqno=87149, guc_id=0, flags=0x73 in no process [-1] <7> [393.709149] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.709147] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.709167] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.709107] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.709252] ------------[ cut here ]------------ <4> [393.709254] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [393.709252] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.709289] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.709289] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <4> [393.709255] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <7> [393.709312] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.709344] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.709411] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.709419] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.709423] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.709424] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.709426] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.709433] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.709538] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.709540] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.709543] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.709545] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.709548] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.709549] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.709550] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.709551] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.709553] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.709554] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.709555] PKRU: 55555554 <4> [393.709557] Call Trace: <4> [393.709559] <TASK> <4> [393.709563] ? lock_acquire+0x20/0x2f0 <4> [393.709571] ? lock_release+0xd0/0x2b0 <4> [393.709576] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.709583] process_one_work+0x239/0x760 <4> [393.709590] worker_thread+0x200/0x3f0 <4> [393.709592] ? __pfx_worker_thread+0x10/0x10 <4> [393.709595] kthread+0x10d/0x150 <4> [393.709598] ? __pfx_kthread+0x10/0x10 <4> [393.709601] ret_from_fork+0x3d4/0x480 <4> [393.709604] ? __pfx_kthread+0x10/0x10 <4> [393.709607] ret_from_fork_asm+0x1a/0x30 <4> [393.709615] </TASK> <4> [393.709616] irq event stamp: 1292531 <4> [393.709617] hardirqs last enabled at (1292537): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.709621] hardirqs last disabled at (1292542): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.709623] softirqs last enabled at (1292370): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.709626] softirqs last disabled at (1292365): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.709629] ---[ end trace 0000000000000000 ]--- <6> [393.709633] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.709725] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.709801] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.709972] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.710082] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.710187] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.710403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.710499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.710597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.710682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.710764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.710846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.710926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.711006] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.711101] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.711212] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.712221] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.722505] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.722757] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.723783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.723861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.723935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.724010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.724083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.724153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.724225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.724295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.724365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.724435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.724512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.724582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.724651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.724719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.724788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.724857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.724925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.724992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.725060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.725139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.725216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.725290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.725364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.725435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.725509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.725580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.725650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.725726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.725802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.725875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.725948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.726020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.726100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.726179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.726258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.726333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.726408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.726482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.726571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.726644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.726718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.726791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.726862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.726931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.727004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.727076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.727147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.727217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.727288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.727356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.727427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.727509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.727585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.727656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.727727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.727798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.727866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.727935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.728008] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.728573] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.728578] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87149, lrc_seqno=87149, guc_id=0, flags=0x73 in no process [-1] <7> [393.728581] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.728641] ------------[ cut here ]------------ <4> [393.728642] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.728643] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.728715] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.728774] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.728779] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.728782] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.728783] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.728784] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.728789] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.728858] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.728860] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.728862] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.728863] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.728864] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.728866] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.728867] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.728868] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.728869] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.728871] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.728872] PKRU: 55555554 <4> [393.728873] Call Trace: <4> [393.728874] <TASK> <4> [393.728878] ? lock_acquire+0x20/0x2f0 <4> [393.728883] ? lock_release+0xd0/0x2b0 <4> [393.728888] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.728894] process_one_work+0x239/0x760 <4> [393.728900] worker_thread+0x200/0x3f0 <4> [393.728902] ? __pfx_worker_thread+0x10/0x10 <4> [393.728905] kthread+0x10d/0x150 <4> [393.728907] ? __pfx_kthread+0x10/0x10 <4> [393.728911] ret_from_fork+0x3d4/0x480 <4> [393.728912] ? __pfx_kthread+0x10/0x10 <4> [393.728916] ret_from_fork_asm+0x1a/0x30 <4> [393.728923] </TASK> <4> [393.728924] irq event stamp: 1295943 <4> [393.728925] hardirqs last enabled at (1295949): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.728927] hardirqs last disabled at (1295954): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.728929] softirqs last enabled at (1295140): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.728932] softirqs last disabled at (1295135): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.728934] ---[ end trace 0000000000000000 ]--- <6> [393.728935] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.729005] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.729012] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.729418] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.729890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.729980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.730070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.730155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.730236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.730316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.730397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.730475] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.730580] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.730692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.731718] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.741512] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.741763] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.742715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.742794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.742869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.742940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.743012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.743083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.743153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.743224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.743296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.743366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.743435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.743510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.743586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.743654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.743723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.743792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.743862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.743932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.744001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.744081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.744157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.744230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.744304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.744375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.744446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.744532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.744604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.744678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.744752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.744824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.744898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.744971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.745048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.745126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.745205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.745279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.745352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.745423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.745495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.745585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.745661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.745734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.745805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.745875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.745949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.746018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.746089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.746159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.746230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.746299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.746368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.746440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.746512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.746582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.746652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.746722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.746791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.746859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.746931] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.747081] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.747085] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87149, lrc_seqno=87149, guc_id=0, flags=0x73 in no process [-1] <7> [393.747087] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.747144] ------------[ cut here ]------------ <4> [393.747145] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.747146] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.747217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.747275] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.747280] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.747282] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.747283] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.747285] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.747290] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.747359] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.747360] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.747362] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.747364] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.747365] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.747366] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.747367] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.747368] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.747370] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.747371] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.747372] PKRU: 55555554 <4> [393.747373] Call Trace: <4> [393.747374] <TASK> <4> [393.747378] ? lock_acquire+0x20/0x2f0 <4> [393.747383] ? lock_release+0xd0/0x2b0 <4> [393.747388] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.747394] process_one_work+0x239/0x760 <4> [393.747400] worker_thread+0x200/0x3f0 <4> [393.747402] ? __pfx_worker_thread+0x10/0x10 <4> [393.747405] kthread+0x10d/0x150 <4> [393.747407] ? __pfx_kthread+0x10/0x10 <4> [393.747411] ret_from_fork+0x3d4/0x480 <4> [393.747413] ? __pfx_kthread+0x10/0x10 <4> [393.747416] ret_from_fork_asm+0x1a/0x30 <4> [393.747423] </TASK> <4> [393.747424] irq event stamp: 1299269 <4> [393.747425] hardirqs last enabled at (1299275): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.747427] hardirqs last disabled at (1299280): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.747430] softirqs last enabled at (1298220): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.747432] softirqs last disabled at (1298213): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.747434] ---[ end trace 0000000000000000 ]--- <7> [393.748125] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.748131] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.748173] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.748194] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.748272] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.748274] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [393.748274] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <5> [393.748680] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87163, lrc_seqno=87163, guc_id=0, flags=0x73 in no process [-1] <7> [393.748683] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.748747] ------------[ cut here ]------------ <4> [393.748748] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.748749] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.748818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.748876] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.748881] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.748883] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.748884] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.748886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.748890] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.748960] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.748961] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.748963] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.748965] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.748966] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.748967] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.748968] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.748969] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.748971] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.748972] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.748973] PKRU: 55555554 <4> [393.748974] Call Trace: <4> [393.748975] <TASK> <4> [393.748979] ? lock_acquire+0x20/0x2f0 <4> [393.748985] ? lock_release+0xd0/0x2b0 <4> [393.748990] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.748996] process_one_work+0x239/0x760 <4> [393.749002] worker_thread+0x200/0x3f0 <4> [393.749005] ? __pfx_worker_thread+0x10/0x10 <4> [393.749007] kthread+0x10d/0x150 <4> [393.749010] ? __pfx_kthread+0x10/0x10 <4> [393.749014] ret_from_fork+0x3d4/0x480 <4> [393.749015] ? __pfx_kthread+0x10/0x10 <4> [393.749019] ret_from_fork_asm+0x1a/0x30 <4> [393.749026] </TASK> <4> [393.749027] irq event stamp: 1300243 <4> [393.749028] hardirqs last enabled at (1300249): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.749031] hardirqs last disabled at (1300254): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.749033] softirqs last enabled at (1298220): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.749036] softirqs last disabled at (1298213): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.749038] ---[ end trace 0000000000000000 ]--- <6> [393.749040] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.749112] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.749119] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.749665] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.749768] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.749869] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.750101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.750187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.750276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.750362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.750444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.750531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.750613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.750692] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.750784] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.750895] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.751904] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.762522] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.762771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.763789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.763866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.763938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.764010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.764083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.764154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.764225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.764297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.764370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.764441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.764512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.764604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.764676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.764745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.764813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.764884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.764957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.765028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.765098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.765177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.765253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.765326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.765400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.765472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.765557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.765628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.765699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.765771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.765846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.765919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.765992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.766065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.766145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.766224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.766303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.766378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.766451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.766527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.766601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.766673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.766746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.766820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.766892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.766962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.767036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.767107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.767179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.767249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.767319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.767388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.767457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.767541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.767616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.767689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.767760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.767831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.767900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.767969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.768042] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.768187] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.768191] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87163, lrc_seqno=87163, guc_id=0, flags=0x73 in no process [-1] <7> [393.768193] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.768250] ------------[ cut here ]------------ <4> [393.768251] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.768253] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.768323] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.768381] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.768386] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.768389] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.768390] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.768391] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.768396] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.768465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.768467] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.768469] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.768471] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.768472] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.768473] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.768474] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.768476] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.768478] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.768479] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.768481] PKRU: 55555554 <4> [393.768482] Call Trace: <4> [393.768483] <TASK> <4> [393.768487] ? lock_acquire+0x20/0x2f0 <4> [393.768493] ? lock_release+0xd0/0x2b0 <4> [393.768498] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.768504] process_one_work+0x239/0x760 <4> [393.768510] worker_thread+0x200/0x3f0 <4> [393.768513] ? __pfx_worker_thread+0x10/0x10 <4> [393.768520] kthread+0x10d/0x150 <4> [393.768524] ? __pfx_kthread+0x10/0x10 <4> [393.768530] ret_from_fork+0x3d4/0x480 <4> [393.768533] ? __pfx_kthread+0x10/0x10 <4> [393.768537] ret_from_fork_asm+0x1a/0x30 <4> [393.768544] </TASK> <4> [393.768545] irq event stamp: 1303577 <4> [393.768546] hardirqs last enabled at (1303583): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.768549] hardirqs last disabled at (1303588): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.768551] softirqs last enabled at (1302608): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.768553] softirqs last disabled at (1302597): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.768555] ---[ end trace 0000000000000000 ]--- <6> [393.768557] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.768626] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.768632] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.769909] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.770015] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.770118] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.770341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.770434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.770540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.770633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.770718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.770803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.770885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.770961] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.771054] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.771167] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.772180] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.782878] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.783127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.784117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.784197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.784271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.784345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.784416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.784488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.784579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.784660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.784733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.784802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.784873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.784942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.785011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.785081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.785150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.785218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.785287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.785355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.785426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.785504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.785597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.785686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.785762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.785838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.785910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.785982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.786053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.786127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.786202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.786274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.786347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.786418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.786496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.786589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.786678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.786755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.786830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.786902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.786974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.787045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.787119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.787193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.787262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.787332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.787405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.787476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.787556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.787638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.787712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.787782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.787852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.787926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.787996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.788067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.788137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.788207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.788277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.788348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.788421] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.788579] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.788584] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87163, lrc_seqno=87163, guc_id=0, flags=0x73 in no process [-1] <7> [393.788586] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.788645] ------------[ cut here ]------------ <4> [393.788646] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.788647] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:42/3607 <4> [393.788718] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.788778] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.788783] CPU: 2 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.788786] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.788787] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.788788] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.788794] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.788862] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.788864] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.788866] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.788868] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.788869] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.788870] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.788871] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.788872] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [393.788874] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.788875] CR2: 00007d9f251a804c CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [393.788876] PKRU: 55555554 <4> [393.788877] Call Trace: <4> [393.788878] <TASK> <4> [393.788882] ? lock_acquire+0x20/0x2f0 <4> [393.788888] ? lock_release+0xd0/0x2b0 <4> [393.788894] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.788899] process_one_work+0x239/0x760 <4> [393.788906] worker_thread+0x200/0x3f0 <4> [393.788908] ? __pfx_worker_thread+0x10/0x10 <4> [393.788911] kthread+0x10d/0x150 <4> [393.788913] ? __pfx_kthread+0x10/0x10 <4> [393.788917] ret_from_fork+0x3d4/0x480 <4> [393.788919] ? __pfx_kthread+0x10/0x10 <4> [393.788922] ret_from_fork_asm+0x1a/0x30 <4> [393.788929] </TASK> <4> [393.788930] irq event stamp: 405353 <4> [393.788931] hardirqs last enabled at (405359): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.788933] hardirqs last disabled at (405364): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.788935] softirqs last enabled at (404252): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.788938] softirqs last disabled at (404245): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.788940] ---[ end trace 0000000000000000 ]--- <5> [393.789533] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87177, lrc_seqno=87177, guc_id=0, flags=0x73 in no process [-1] <7> [393.789584] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.789588] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.789542] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [393.789627] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.789644] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.789691] ------------[ cut here ]------------ <4> [393.789695] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [393.789748] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.789748] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.789699] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <7> [393.789780] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.789815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.789881] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.789889] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.789894] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.789896] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.789899] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.789908] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.789989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.789991] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.789994] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.789996] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.789998] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.790000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.790001] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.790003] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.790004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.790006] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.790008] PKRU: 55555554 <4> [393.790011] Call Trace: <4> [393.790012] <TASK> <4> [393.790017] ? lock_acquire+0x20/0x2f0 <4> [393.790025] ? lock_release+0xd0/0x2b0 <4> [393.790031] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.790037] process_one_work+0x239/0x760 <4> [393.790045] worker_thread+0x200/0x3f0 <4> [393.790048] ? __pfx_worker_thread+0x10/0x10 <4> [393.790051] kthread+0x10d/0x150 <4> [393.790056] ? __pfx_kthread+0x10/0x10 <4> [393.790060] ret_from_fork+0x3d4/0x480 <4> [393.790063] ? __pfx_kthread+0x10/0x10 <4> [393.790066] ret_from_fork_asm+0x1a/0x30 <4> [393.790074] </TASK> <4> [393.790075] irq event stamp: 1305389 <4> [393.790077] hardirqs last enabled at (1305395): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.790081] hardirqs last disabled at (1305400): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.790084] softirqs last enabled at (1304104): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [393.790087] softirqs last disabled at (1304102): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [393.790089] ---[ end trace 0000000000000000 ]--- <6> [393.790092] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.790170] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.790184] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.790365] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.790472] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.790613] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.790827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.790918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.791009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.791093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.791176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.791258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.791338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.791419] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.791514] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.791650] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.792661] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.802541] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.802791] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.803807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.803884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.803958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.804032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.804106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.804179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.804251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.804323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.804394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.804466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.804541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.804613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.804684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.804755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.804825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.804895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.804965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.805035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.805106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.805185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.805263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.805338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.805413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.805486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.805570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.805643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.805714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.805788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.805863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.805936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.806009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.806082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.806160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.806238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.806315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.806389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.806463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.806542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.806622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.806693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.806766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.806837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.806908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.806981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.807054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.807125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.807195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.807264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.807334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.807403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.807472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.807578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.807652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.807723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.807793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.807865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.807933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.808002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.808073] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.808218] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.808223] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87177, lrc_seqno=87177, guc_id=0, flags=0x73 in no process [-1] <7> [393.808225] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.808283] ------------[ cut here ]------------ <4> [393.808284] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.808285] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.808355] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.808414] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.808419] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.808421] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.808422] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.808424] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.808429] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.808497] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.808498] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.808501] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.808502] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.808503] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.808504] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.808505] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.808507] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.808508] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.808509] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.808511] PKRU: 55555554 <4> [393.808512] Call Trace: <4> [393.808513] <TASK> <4> [393.808516] ? lock_acquire+0x20/0x2f0 <4> [393.808522] ? lock_release+0xd0/0x2b0 <4> [393.808527] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.808537] process_one_work+0x239/0x760 <4> [393.808543] worker_thread+0x200/0x3f0 <4> [393.808545] ? __pfx_worker_thread+0x10/0x10 <4> [393.808548] kthread+0x10d/0x150 <4> [393.808551] ? __pfx_kthread+0x10/0x10 <4> [393.808554] ret_from_fork+0x3d4/0x480 <4> [393.808556] ? __pfx_kthread+0x10/0x10 <4> [393.808560] ret_from_fork_asm+0x1a/0x30 <4> [393.808567] </TASK> <4> [393.808568] irq event stamp: 1308795 <4> [393.808569] hardirqs last enabled at (1308801): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.808572] hardirqs last disabled at (1308806): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.808574] softirqs last enabled at (1307826): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.808576] softirqs last disabled at (1307755): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.808578] ---[ end trace 0000000000000000 ]--- <6> [393.808580] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.808648] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.808654] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.809060] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.809272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.809355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.809439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.809519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.809616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.809694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.809771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.809847] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.809941] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.810052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.811070] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.821556] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.821807] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.822821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.822900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.822973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.823047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.823121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.823193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.823264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.823335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.823406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.823476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.823557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.823627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.823697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.823766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.823835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.823904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.823975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.824044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.824113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.824192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.824270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.824345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.824420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.824493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.824583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.824657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.824730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.824804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.824879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.824952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.825027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.825099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.825177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.825255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.825333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.825406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.825480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.825559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.825635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.825708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.825782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.825856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.825927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.825997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.826071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.826142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.826212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.826283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.826355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.826425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.826494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.826577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.826648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.826719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.826789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.826860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.826930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.827000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.827074] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.827225] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.827229] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87177, lrc_seqno=87177, guc_id=0, flags=0x73 in no process [-1] <7> [393.827231] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.827290] ------------[ cut here ]------------ <4> [393.827291] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.827292] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.827362] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.827420] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.827425] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.827428] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.827429] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.827430] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.827435] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.827503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.827504] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.827506] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.827507] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.827509] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.827510] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.827511] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.827512] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.827513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.827515] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.827516] PKRU: 55555554 <4> [393.827517] Call Trace: <4> [393.827518] <TASK> <4> [393.827522] ? lock_acquire+0x20/0x2f0 <4> [393.827527] ? lock_release+0xd0/0x2b0 <4> [393.827532] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.827538] process_one_work+0x239/0x760 <4> [393.827553] worker_thread+0x200/0x3f0 <4> [393.827558] ? __pfx_worker_thread+0x10/0x10 <4> [393.827560] kthread+0x10d/0x150 <4> [393.827563] ? __pfx_kthread+0x10/0x10 <4> [393.827567] ret_from_fork+0x3d4/0x480 <4> [393.827569] ? __pfx_kthread+0x10/0x10 <4> [393.827572] ret_from_fork_asm+0x1a/0x30 <4> [393.827579] </TASK> <4> [393.827580] irq event stamp: 1312113 <4> [393.827581] hardirqs last enabled at (1312119): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.827584] hardirqs last disabled at (1312124): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.827586] softirqs last enabled at (1310944): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.827588] softirqs last disabled at (1310937): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.827590] ---[ end trace 0000000000000000 ]--- <5> [393.828696] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87191, lrc_seqno=87191, guc_id=0, flags=0x73 in no process [-1] <7> [393.828701] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [393.828734] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.828746] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.828677] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.828751] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.828766] ------------[ cut here ]------------ <4> [393.828767] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.828768] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:42/3607 <4> [393.828844] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper <7> [393.828849] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.828854] drm_buddy drm_ttm_helper ttm <7> [393.828856] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.828860] gpu_sched <4> [393.828862] drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp <7> [393.828874] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.828878] mei_pxp <4> [393.828880] mtd sparse_keymap platform_profile wmi_bmof <7> [393.828879] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.828883] kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm <7> [393.828829] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [393.828897] binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.828920] CPU: 2 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.828922] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.828923] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.828925] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.828929] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.829000] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.829002] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.829005] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.829006] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.829008] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.829009] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.829010] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.829012] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [393.829013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.829015] CR2: 00007d9f251a804c CR3: 000000013e95d004 CR4: 0000000000f72ef0 <4> [393.829016] PKRU: 55555554 <4> [393.829018] Call Trace: <4> [393.829019] <TASK> <4> [393.829023] ? lock_acquire+0x20/0x2f0 <4> [393.829029] ? lock_release+0xd0/0x2b0 <4> [393.829034] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.829039] process_one_work+0x239/0x760 <4> [393.829046] worker_thread+0x200/0x3f0 <4> [393.829048] ? __pfx_worker_thread+0x10/0x10 <4> [393.829051] kthread+0x10d/0x150 <4> [393.829054] ? __pfx_kthread+0x10/0x10 <4> [393.829057] ret_from_fork+0x3d4/0x480 <4> [393.829059] ? __pfx_kthread+0x10/0x10 <4> [393.829063] ret_from_fork_asm+0x1a/0x30 <4> [393.829070] </TASK> <4> [393.829071] irq event stamp: 407661 <4> [393.829072] hardirqs last enabled at (407667): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.829075] hardirqs last disabled at (407672): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.829077] softirqs last enabled at (406396): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [393.829080] softirqs last disabled at (406394): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [393.829082] ---[ end trace 0000000000000000 ]--- <6> [393.829084] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.829153] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.829160] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.829583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.829799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.829889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.829980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.830064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.830147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.830228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.830310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.830389] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.830481] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.830603] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.831625] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.841555] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.841806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.842808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.842888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.842962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.843033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.843104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.843174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.843243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.843314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.843385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.843456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.843526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.843617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.843688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.843756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.843826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.843894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.843961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.844030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.844099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.844178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.844254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.844326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.844400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.844471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.844541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.844630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.844704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.844778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.844853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.844926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.844999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.845073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.845150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.845228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.845306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.845381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.845454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.845526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.845613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.845684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.845756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.845828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.845900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.845970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.846045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.846116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.846185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.846256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.846327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.846395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.846465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.846535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.846622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.846693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.846762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.846832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.846900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.846969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.847040] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.847170] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.847175] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87191, lrc_seqno=87191, guc_id=0, flags=0x73 in no process [-1] <7> [393.847177] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.847234] ------------[ cut here ]------------ <4> [393.847235] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.847237] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.847307] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.847366] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.847371] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.847374] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.847375] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.847376] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.847381] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.847449] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.847451] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.847454] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.847455] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.847457] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.847458] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.847459] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.847461] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.847463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.847464] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.847466] PKRU: 55555554 <4> [393.847467] Call Trace: <4> [393.847468] <TASK> <4> [393.847472] ? lock_acquire+0x20/0x2f0 <4> [393.847478] ? lock_release+0xd0/0x2b0 <4> [393.847483] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.847489] process_one_work+0x239/0x760 <4> [393.847495] worker_thread+0x200/0x3f0 <4> [393.847498] ? __pfx_worker_thread+0x10/0x10 <4> [393.847500] kthread+0x10d/0x150 <4> [393.847503] ? __pfx_kthread+0x10/0x10 <4> [393.847506] ret_from_fork+0x3d4/0x480 <4> [393.847508] ? __pfx_kthread+0x10/0x10 <4> [393.847512] ret_from_fork_asm+0x1a/0x30 <4> [393.847519] </TASK> <4> [393.847520] irq event stamp: 1315725 <4> [393.847521] hardirqs last enabled at (1315731): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.847524] hardirqs last disabled at (1315736): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.847527] softirqs last enabled at (1314564): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.847529] softirqs last disabled at (1314555): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.847531] ---[ end trace 0000000000000000 ]--- <6> [393.847533] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.848790] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.848796] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.848881] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.848984] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.849086] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.849299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.849382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.849469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.849561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.849644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.849724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.849804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.849880] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.849972] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.850086] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.851094] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.861562] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.861815] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.862846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.862923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.862995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.863068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.863140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.863211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.863281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.863354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.863425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.863495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.863576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.863647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.863717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.863788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.863860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.863930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.864000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.864068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.864137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.864217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.864294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.864368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.864443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.864515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.864595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.864666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.864735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.864808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.864881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.864953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.865026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.865099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.865175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.865251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.865330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.865405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.865478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.865549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.865639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.865710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.865784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.865856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.865926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.865996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.866069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.866140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.866211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.866281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.866353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.866425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.866497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.866581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.866654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.866724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.866793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.866863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.866932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.866999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.867071] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.867221] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.867225] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87191, lrc_seqno=87191, guc_id=0, flags=0x73 in no process [-1] <7> [393.867227] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.867284] ------------[ cut here ]------------ <4> [393.867285] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.867287] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [393.867358] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.867420] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.867426] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.867428] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.867430] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.867431] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.867436] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.867505] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.867507] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [393.867509] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.867510] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.867512] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.867513] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.867514] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.867516] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [393.867518] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.867519] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.867521] PKRU: 55555554 <4> [393.867522] Call Trace: <4> [393.867523] <TASK> <4> [393.867527] ? lock_acquire+0x20/0x2f0 <4> [393.867533] ? lock_release+0xd0/0x2b0 <4> [393.867538] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.867544] process_one_work+0x239/0x760 <4> [393.867550] worker_thread+0x200/0x3f0 <4> [393.867553] ? __pfx_worker_thread+0x10/0x10 <4> [393.867555] kthread+0x10d/0x150 <4> [393.867563] ? __pfx_kthread+0x10/0x10 <4> [393.867570] ret_from_fork+0x3d4/0x480 <4> [393.867573] ? __pfx_kthread+0x10/0x10 <4> [393.867577] ret_from_fork_asm+0x1a/0x30 <4> [393.867585] </TASK> <4> [393.867586] irq event stamp: 1319079 <4> [393.867587] hardirqs last enabled at (1319085): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.867589] hardirqs last disabled at (1319090): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.867592] softirqs last enabled at (1318110): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.867594] softirqs last disabled at (1318105): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.867596] ---[ end trace 0000000000000000 ]--- <5> [393.868160] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87205, lrc_seqno=87205, guc_id=0, flags=0x73 in no process [-1] <7> [393.868205] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.868219] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.868221] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.868171] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.868310] ------------[ cut here ]------------ <4> [393.868313] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [393.868326] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.868327] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.868343] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.868342] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.868316] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:63/3628 <4> [393.868434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.868569] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.868580] CPU: 8 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.868584] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.868585] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.868589] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.868599] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.868762] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.868766] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.868772] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.868774] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.868777] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.868780] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.868783] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.868786] FS: 0000000000000000(0000) GS:ffff8888db098000(0000) knlGS:0000000000000000 <4> [393.868789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.868792] CR2: 000064585b235214 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [393.868795] PKRU: 55555554 <4> [393.868798] Call Trace: <4> [393.868801] <TASK> <4> [393.868809] ? lock_acquire+0x20/0x2f0 <4> [393.868820] ? lock_release+0xd0/0x2b0 <4> [393.868830] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.868841] process_one_work+0x239/0x760 <4> [393.868853] worker_thread+0x200/0x3f0 <4> [393.868859] ? __pfx_worker_thread+0x10/0x10 <4> [393.868863] kthread+0x10d/0x150 <4> [393.868870] ? __pfx_kthread+0x10/0x10 <4> [393.868876] ret_from_fork+0x3d4/0x480 <4> [393.868881] ? __pfx_kthread+0x10/0x10 <4> [393.868887] ret_from_fork_asm+0x1a/0x30 <4> [393.868900] </TASK> <4> [393.868902] irq event stamp: 246303 <4> [393.868904] hardirqs last enabled at (246309): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.868909] hardirqs last disabled at (246314): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.868912] softirqs last enabled at (246062): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.868916] softirqs last disabled at (246057): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.868920] ---[ end trace 0000000000000000 ]--- <6> [393.868932] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.869013] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.869022] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.869005] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.869110] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.869218] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.869492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.869640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.869750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.869843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.869930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.870013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.870128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.870208] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.870307] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.870423] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.871446] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.881571] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.881823] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.882822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.882901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.882978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.883096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.883186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.883268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.883340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.883419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.883490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.883561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.883653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.883723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.883825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.883895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.883974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.884045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.884122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.884192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.884262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.884341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.884418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.884492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.884599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.884674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.884754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.884825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.884903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.884976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.885050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.885123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.885196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.885272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.885386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.885467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.885551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.885646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.885729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.885804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.885875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.885946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.886020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.886125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.886200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.886281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.886357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.886436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.886508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.886586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.886658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.886727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.886804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.886905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.886978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.887056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.887125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.887206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.887277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.887349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.887425] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.887578] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.887584] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87205, lrc_seqno=87205, guc_id=0, flags=0x73 in no process [-1] <7> [393.887588] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.887674] ------------[ cut here ]------------ <4> [393.887675] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.887676] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:45/3610 <4> [393.887750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.887820] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.887825] CPU: 4 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.887828] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.887829] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.887830] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.887835] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.887905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.887906] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [393.887908] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.887910] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.887911] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.887912] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.887913] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.887914] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [393.887916] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.887917] CR2: 00007021e5a09b40 CR3: 00000001e2d1a003 CR4: 0000000000f72ef0 <4> [393.887919] PKRU: 55555554 <4> [393.887920] Call Trace: <4> [393.887921] <TASK> <4> [393.887924] ? lock_acquire+0x20/0x2f0 <4> [393.887930] ? lock_release+0xd0/0x2b0 <4> [393.887935] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.887941] process_one_work+0x239/0x760 <4> [393.887952] worker_thread+0x200/0x3f0 <4> [393.887957] ? __pfx_worker_thread+0x10/0x10 <4> [393.887961] kthread+0x10d/0x150 <4> [393.887964] ? __pfx_kthread+0x10/0x10 <4> [393.887968] ret_from_fork+0x3d4/0x480 <4> [393.887970] ? __pfx_kthread+0x10/0x10 <4> [393.887973] ret_from_fork_asm+0x1a/0x30 <4> [393.887980] </TASK> <4> [393.887981] irq event stamp: 566743 <4> [393.887982] hardirqs last enabled at (566749): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.887985] hardirqs last disabled at (566754): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.887987] softirqs last enabled at (565750): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.887989] softirqs last disabled at (565745): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.887991] ---[ end trace 0000000000000000 ]--- <6> [393.887993] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.888062] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.888068] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.888474] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.888726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.888819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.888905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.888995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.889075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.889153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.889232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.889332] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.889435] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.889555] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.890614] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.901352] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.901603] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.902597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.902677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.902752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.902824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.902899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.902972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.903044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.903119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.903218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.903290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.903367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.903437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.903513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.903592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.903662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.903732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.903800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.903875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.903971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.904052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.904137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.904211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.904294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.904367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.904440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.904511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.904593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.904690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.904766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.904848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.904922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.905002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.905079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.905158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.905237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.905312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.905420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.905499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.905584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.905656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.905741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.905818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.905893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.905965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.906040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.906131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.906218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.906293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.906370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.906443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.906521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.906607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.906680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.906753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.906823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.906928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.907001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.907080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.907155] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.907309] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.907313] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87205, lrc_seqno=87205, guc_id=0, flags=0x73 in no process [-1] <7> [393.907316] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.907375] ------------[ cut here ]------------ <4> [393.907376] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.907378] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:45/3610 <4> [393.907449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.907508] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.907513] CPU: 4 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.907516] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.907517] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.907518] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.907523] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.907606] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.907608] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [393.907610] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.907612] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.907614] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.907616] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.907618] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.907620] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [393.907623] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.907625] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [393.907628] PKRU: 55555554 <4> [393.907630] Call Trace: <4> [393.907632] <TASK> <4> [393.907639] ? lock_acquire+0x20/0x2f0 <4> [393.907648] ? lock_release+0xd0/0x2b0 <4> [393.907657] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.907664] process_one_work+0x239/0x760 <4> [393.907675] worker_thread+0x200/0x3f0 <4> [393.907680] ? __pfx_worker_thread+0x10/0x10 <4> [393.907684] kthread+0x10d/0x150 <4> [393.907689] ? __pfx_kthread+0x10/0x10 <4> [393.907695] ret_from_fork+0x3d4/0x480 <4> [393.907698] ? __pfx_kthread+0x10/0x10 <4> [393.907703] ret_from_fork_asm+0x1a/0x30 <4> [393.907714] </TASK> <4> [393.907715] irq event stamp: 570075 <4> [393.907716] hardirqs last enabled at (570081): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.907719] hardirqs last disabled at (570086): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.907721] softirqs last enabled at (569106): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.907723] softirqs last disabled at (569101): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.907726] ---[ end trace 0000000000000000 ]--- <7> [393.908964] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.908967] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.908994] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.908999] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.909000] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [393.909014] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87219, lrc_seqno=87219, guc_id=0, flags=0x73 in no process [-1] <7> [393.909039] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.909040] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.909019] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [393.909024] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [393.909103] ------------[ cut here ]------------ <4> [393.909104] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.909105] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:63/3628 <4> [393.909181] Modules linked in: snd_hda_codec_intelhdmi <7> [393.909135] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [393.909184] snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [393.909244] [last unloaded: xe_live_test] <4> [393.909247] CPU: 7 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.909250] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.909251] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.909252] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.909258] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.909331] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.909332] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.909334] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.909336] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.909337] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.909338] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.909339] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.909340] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [393.909342] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.909343] CR2: 00007021e33f8000 CR3: 000000012c104004 CR4: 0000000000f72ef0 <4> [393.909344] PKRU: 55555554 <4> [393.909346] Call Trace: <4> [393.909347] <TASK> <4> [393.909350] ? lock_acquire+0x20/0x2f0 <4> [393.909356] ? lock_release+0xd0/0x2b0 <4> [393.909361] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.909367] process_one_work+0x239/0x760 <4> [393.909373] worker_thread+0x200/0x3f0 <4> [393.909376] ? __pfx_worker_thread+0x10/0x10 <4> [393.909378] kthread+0x10d/0x150 <4> [393.909380] ? __pfx_kthread+0x10/0x10 <4> [393.909384] ret_from_fork+0x3d4/0x480 <4> [393.909386] ? __pfx_kthread+0x10/0x10 <4> [393.909389] ret_from_fork_asm+0x1a/0x30 <4> [393.909397] </TASK> <4> [393.909398] irq event stamp: 248909 <4> [393.909399] hardirqs last enabled at (248915): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.909402] hardirqs last disabled at (248920): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.909404] softirqs last enabled at (247720): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [393.909407] softirqs last disabled at (247718): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [393.909409] ---[ end trace 0000000000000000 ]--- <6> [393.909411] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.909482] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.909489] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.909677] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.909893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.909981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.910071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.910156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.910240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.910323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.910406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.910487] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.910587] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.910699] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.911709] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.921589] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.921838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.922861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.922938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.923009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.923081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.923154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.923227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.923298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.923369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.923440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.923510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.923587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.923669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.923739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.923808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.923878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.923948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.924015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.924084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.924153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.924233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.924309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.924383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.924457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.924529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.924609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.924681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.924752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.924825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.924898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.924970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.925041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.925113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.925190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.925266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.925343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.925417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.925490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.925561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.925646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.925720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.925794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.925868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.925939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.926009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.926082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.926154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.926225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.926293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.926365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.926435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.926504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.926578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.926666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.926737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.926809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.926882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.926951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.927021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.927094] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.927242] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.927246] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87219, lrc_seqno=87219, guc_id=0, flags=0x73 in no process [-1] <7> [393.927248] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.927307] ------------[ cut here ]------------ <4> [393.927308] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.927310] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:45/3610 <4> [393.927381] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.927441] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.927446] CPU: 4 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.927448] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.927449] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.927451] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.927455] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.927525] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.927526] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [393.927529] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.927530] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.927531] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.927532] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.927533] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.927535] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [393.927536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.927537] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [393.927539] PKRU: 55555554 <4> [393.927540] Call Trace: <4> [393.927541] <TASK> <4> [393.927544] ? lock_acquire+0x20/0x2f0 <4> [393.927550] ? lock_release+0xd0/0x2b0 <4> [393.927555] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.927560] process_one_work+0x239/0x760 <4> [393.927566] worker_thread+0x200/0x3f0 <4> [393.927569] ? __pfx_worker_thread+0x10/0x10 <4> [393.927571] kthread+0x10d/0x150 <4> [393.927574] ? __pfx_kthread+0x10/0x10 <4> [393.927577] ret_from_fork+0x3d4/0x480 <4> [393.927579] ? __pfx_kthread+0x10/0x10 <4> [393.927588] ret_from_fork_asm+0x1a/0x30 <4> [393.927596] </TASK> <4> [393.927597] irq event stamp: 573951 <4> [393.927598] hardirqs last enabled at (573957): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.927601] hardirqs last disabled at (573962): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.927603] softirqs last enabled at (572682): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.927606] softirqs last disabled at (572673): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.927608] ---[ end trace 0000000000000000 ]--- <6> [393.928533] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [393.928639] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.928741] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [393.928834] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.928840] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.929011] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.929227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.929317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.929408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.929495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.929581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.929698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.929780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.929859] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.929953] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.930066] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.931077] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.941596] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.941845] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.942812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.942889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.942962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.943035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.943108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.943179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.943250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.943321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.943391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.943462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.943532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.943605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.943675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.943745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.943815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.943885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.943957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.944029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.944101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.944180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.944257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.944332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.944407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.944479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.944551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.944654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.944724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.944798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.944872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.944944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.945015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.945087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.945164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.945241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.945318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.945392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.945465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.945536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.945615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.945687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.945761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.945833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.945903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.945973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.946046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.946116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.946187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.946260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.946333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.946404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.946474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.946546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.946623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.946695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.946765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.946839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.946910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.946980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.947053] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.947204] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.947208] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87219, lrc_seqno=87219, guc_id=0, flags=0x73 in no process [-1] <7> [393.947210] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.947268] ------------[ cut here ]------------ <4> [393.947269] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.947271] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:63/3628 <4> [393.947342] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.947401] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.947406] CPU: 7 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.947408] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.947409] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.947411] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.947416] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.947485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.947487] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.947489] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.947490] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.947491] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.947492] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.947493] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.947495] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [393.947496] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.947498] CR2: 00007021e33f8000 CR3: 000000012c104004 CR4: 0000000000f72ef0 <4> [393.947499] PKRU: 55555554 <4> [393.947500] Call Trace: <4> [393.947501] <TASK> <4> [393.947505] ? lock_acquire+0x20/0x2f0 <4> [393.947511] ? lock_release+0xd0/0x2b0 <4> [393.947516] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.947522] process_one_work+0x239/0x760 <4> [393.947528] worker_thread+0x200/0x3f0 <4> [393.947530] ? __pfx_worker_thread+0x10/0x10 <4> [393.947533] kthread+0x10d/0x150 <4> [393.947535] ? __pfx_kthread+0x10/0x10 <4> [393.947539] ret_from_fork+0x3d4/0x480 <4> [393.947541] ? __pfx_kthread+0x10/0x10 <4> [393.947544] ret_from_fork_asm+0x1a/0x30 <4> [393.947551] </TASK> <4> [393.947552] irq event stamp: 253283 <4> [393.947553] hardirqs last enabled at (253289): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.947556] hardirqs last disabled at (253294): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.947558] softirqs last enabled at (252228): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.947561] softirqs last disabled at (252219): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.947563] ---[ end trace 0000000000000000 ]--- <5> [393.948145] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87233, lrc_seqno=87233, guc_id=0, flags=0x73 in no process [-1] <7> [393.948201] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.948153] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.948261] ------------[ cut here ]------------ <4> [393.948264] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [393.948294] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.948266] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:55/3620 <4> [393.948346] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.948419] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.948427] CPU: 5 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.948431] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.948433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.948434] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [393.948436] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.948444] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.948452] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.948441] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [393.948498] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.948511] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.948523] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.948526] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [393.948538] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.948540] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.948542] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.948543] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.948544] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.948545] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [393.948547] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.948548] CR2: 00007d287d0b8520 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [393.948550] PKRU: 55555554 <4> [393.948551] Call Trace: <4> [393.948552] <TASK> <4> [393.948557] ? lock_acquire+0x20/0x2f0 <4> [393.948564] ? lock_release+0xd0/0x2b0 <4> [393.948571] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.948577] process_one_work+0x239/0x760 <4> [393.948585] worker_thread+0x200/0x3f0 <4> [393.948588] ? __pfx_worker_thread+0x10/0x10 <4> [393.948598] kthread+0x10d/0x150 <4> [393.948603] ? __pfx_kthread+0x10/0x10 <4> [393.948607] ret_from_fork+0x3d4/0x480 <4> [393.948610] ? __pfx_kthread+0x10/0x10 <4> [393.948614] ret_from_fork_asm+0x1a/0x30 <4> [393.948621] </TASK> <4> [393.948622] irq event stamp: 409907 <4> [393.948623] hardirqs last enabled at (409913): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.948626] hardirqs last disabled at (409918): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.948628] softirqs last enabled at (408598): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [393.948630] softirqs last disabled at (408596): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [393.948632] ---[ end trace 0000000000000000 ]--- <6> [393.948635] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.948728] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.948743] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.948965] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.949069] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.949173] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.949385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.949475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.949567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.949674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.949759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.949843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.949925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.950004] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.950097] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.950210] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.951248] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.961606] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.961883] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.962917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.962995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.963069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.963142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.963214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.963284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.963355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.963425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.963496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.963566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.963661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.963732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.963801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.963870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.963937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.964007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.964075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.964144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.964213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.964292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.964367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.964442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.964515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.964586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.964674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.964745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.964815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.964888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.964962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.965035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.965110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.965182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.965260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.965338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.965416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.965492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.965568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.965652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.965725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.965795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.965870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.965943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.966014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.966081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.966154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.966223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.966296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.966367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.966441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.966513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.966583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.966670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.966740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.966810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.966879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.966949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.967018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.967088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.967160] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.967306] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.967310] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87233, lrc_seqno=87233, guc_id=0, flags=0x73 in no process [-1] <7> [393.967313] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.967371] ------------[ cut here ]------------ <4> [393.967372] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.967373] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:55/3620 <4> [393.967444] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.967503] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.967508] CPU: 5 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.967510] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.967511] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.967513] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.967518] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.967586] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.967588] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [393.967591] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.967592] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.967594] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.967595] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.967596] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.967603] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [393.967606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.967608] CR2: 00007d287d0b8520 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [393.967609] PKRU: 55555554 <4> [393.967611] Call Trace: <4> [393.967612] <TASK> <4> [393.967616] ? lock_acquire+0x20/0x2f0 <4> [393.967621] ? lock_release+0xd0/0x2b0 <4> [393.967627] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.967633] process_one_work+0x239/0x760 <4> [393.967639] worker_thread+0x200/0x3f0 <4> [393.967642] ? __pfx_worker_thread+0x10/0x10 <4> [393.967645] kthread+0x10d/0x150 <4> [393.967648] ? __pfx_kthread+0x10/0x10 <4> [393.967651] ret_from_fork+0x3d4/0x480 <4> [393.967653] ? __pfx_kthread+0x10/0x10 <4> [393.967657] ret_from_fork_asm+0x1a/0x30 <4> [393.967664] </TASK> <4> [393.967665] irq event stamp: 413295 <4> [393.967667] hardirqs last enabled at (413301): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.967669] hardirqs last disabled at (413306): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.967672] softirqs last enabled at (412126): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.967674] softirqs last disabled at (412119): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.967677] ---[ end trace 0000000000000000 ]--- <6> [393.967679] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.967748] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.967754] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.969026] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.969130] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.969231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.969720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.969808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.969900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.969985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.970069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.970151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.970233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.970311] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.970404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.970516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.971519] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [393.981614] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [393.981863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [393.982814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [393.982893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [393.982966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [393.983039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [393.983111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [393.983183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [393.983255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [393.983327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [393.983400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [393.983473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [393.983544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [393.983622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [393.983716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [393.983789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [393.983859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [393.983930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [393.984001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [393.984071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [393.984141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [393.984220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [393.984297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [393.984371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [393.984446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [393.984518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [393.984589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [393.984676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [393.984771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [393.984848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [393.984923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [393.984996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [393.985069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [393.985141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [393.985218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [393.985296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [393.985372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [393.985445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [393.985517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [393.985588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [393.985671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [393.985765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [393.985842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [393.985915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [393.985987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [393.986057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [393.986131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [393.986203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [393.986274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [393.986343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [393.986414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [393.986482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [393.986550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [393.986631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [393.986728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [393.986801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [393.986871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [393.986942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [393.987013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [393.987083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [393.987156] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [393.987303] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [393.987308] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87233, lrc_seqno=87233, guc_id=0, flags=0x73 in no process [-1] <7> [393.987310] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.987368] ------------[ cut here ]------------ <4> [393.987369] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [393.987371] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:63/3628 <4> [393.987442] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [393.987502] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.987507] CPU: 7 UID: 0 PID: 3628 Comm: kworker/u64:63 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.987510] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.987511] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.987513] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.987518] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.987586] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.987588] RSP: 0018:ffffc90005507ca0 EFLAGS: 00010246 <4> [393.987590] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.987591] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.987592] RBP: ffffc90005507db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.987593] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.987595] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.987596] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [393.987597] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.987599] CR2: 00007021e33f8000 CR3: 000000012c104004 CR4: 0000000000f72ef0 <4> [393.987600] PKRU: 55555554 <4> [393.987601] Call Trace: <4> [393.987602] <TASK> <4> [393.987611] ? lock_acquire+0x20/0x2f0 <4> [393.987618] ? lock_release+0xd0/0x2b0 <4> [393.987623] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.987629] process_one_work+0x239/0x760 <4> [393.987636] worker_thread+0x200/0x3f0 <4> [393.987639] ? __pfx_worker_thread+0x10/0x10 <4> [393.987641] kthread+0x10d/0x150 <4> [393.987644] ? __pfx_kthread+0x10/0x10 <4> [393.987647] ret_from_fork+0x3d4/0x480 <4> [393.987650] ? __pfx_kthread+0x10/0x10 <4> [393.987655] ret_from_fork_asm+0x1a/0x30 <4> [393.987666] </TASK> <4> [393.987668] irq event stamp: 257009 <4> [393.987670] hardirqs last enabled at (257015): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.987674] hardirqs last disabled at (257020): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.987677] softirqs last enabled at (256040): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.987680] softirqs last disabled at (256035): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.987683] ---[ end trace 0000000000000000 ]--- <5> [393.988216] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87247, lrc_seqno=87247, guc_id=0, flags=0x73 in no process [-1] <7> [393.988267] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.988224] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [393.988373] ------------[ cut here ]------------ <4> [393.988377] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [393.988426] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.988443] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.988380] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:42/3607 <4> [393.988515] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm <7> [393.988523] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [393.988524] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.988532] drm_gpusvm_helper drm_buddy <7> [393.988534] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.988539] drm_ttm_helper ttm gpu_sched drm_suballoc_helper <7> [393.988542] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [393.988546] drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [393.988638] CPU: 2 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [393.988642] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [393.988643] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [393.988646] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [393.988653] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [393.988751] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [393.988752] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [393.988755] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [393.988756] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [393.988758] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [393.988759] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [393.988760] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [393.988761] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [393.988763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [393.988764] CR2: 00007d9f251a804c CR3: 000000012c104001 CR4: 0000000000f72ef0 <4> [393.988766] PKRU: 55555554 <4> [393.988768] Call Trace: <4> [393.988769] <TASK> <4> [393.988773] ? lock_acquire+0x20/0x2f0 <4> [393.988780] ? lock_release+0xd0/0x2b0 <4> [393.988785] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [393.988791] process_one_work+0x239/0x760 <4> [393.988799] worker_thread+0x200/0x3f0 <4> [393.988801] ? __pfx_worker_thread+0x10/0x10 <4> [393.988804] kthread+0x10d/0x150 <4> [393.988806] ? __pfx_kthread+0x10/0x10 <4> [393.988810] ret_from_fork+0x3d4/0x480 <4> [393.988811] ? __pfx_kthread+0x10/0x10 <4> [393.988814] ret_from_fork_asm+0x1a/0x30 <4> [393.988822] </TASK> <4> [393.988823] irq event stamp: 410375 <4> [393.988824] hardirqs last enabled at (410381): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [393.988827] hardirqs last disabled at (410386): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [393.988829] softirqs last enabled at (410106): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.988831] softirqs last disabled at (410101): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [393.988833] ---[ end trace 0000000000000000 ]--- <6> [393.988836] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [393.988915] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [393.988987] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [393.989105] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [393.989215] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [393.989321] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [393.989546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [393.989671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [393.989765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [393.989848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [393.989947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [393.990053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [393.990137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [393.990223] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [393.990323] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [393.990435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [393.991460] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.001626] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.001878] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.002837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.002916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.003022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.003110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.003190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.003262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.003341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.003414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.003486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.003558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.003636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.003736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.003828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.003919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.003991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.004069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.004139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.004219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.004289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.004367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.004445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.004521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.004625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.004708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.004781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.004859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.004929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.005003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.005077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.005149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.005234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.005329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.005411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.005497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.005585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.005687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.005763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.005836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.005908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.005978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.006117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.006207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.006289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.006369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.006449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.006524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.006602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.006715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.006797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.006870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.006942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.007016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.007088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.007160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.007231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.007304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.007374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.007444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.007518] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.007676] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.007682] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87247, lrc_seqno=87247, guc_id=0, flags=0x73 in no process [-1] <7> [394.007685] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.007749] ------------[ cut here ]------------ <4> [394.007750] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.007752] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3607 <4> [394.007823] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.007891] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.007897] CPU: 7 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.007900] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.007901] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.007902] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.007908] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.007977] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.007978] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.007981] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.007982] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.007984] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.007985] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.007986] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.007987] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.007989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.007990] CR2: 00007021e33f8000 CR3: 000000012c104004 CR4: 0000000000f72ef0 <4> [394.007992] PKRU: 55555554 <4> [394.007993] Call Trace: <4> [394.007994] <TASK> <4> [394.007997] ? lock_acquire+0x20/0x2f0 <4> [394.008003] ? lock_release+0xd0/0x2b0 <4> [394.008008] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.008013] process_one_work+0x239/0x760 <4> [394.008019] worker_thread+0x200/0x3f0 <4> [394.008022] ? __pfx_worker_thread+0x10/0x10 <4> [394.008024] kthread+0x10d/0x150 <4> [394.008027] ? __pfx_kthread+0x10/0x10 <4> [394.008030] ret_from_fork+0x3d4/0x480 <4> [394.008032] ? __pfx_kthread+0x10/0x10 <4> [394.008035] ret_from_fork_asm+0x1a/0x30 <4> [394.008042] </TASK> <4> [394.008043] irq event stamp: 413831 <4> [394.008044] hardirqs last enabled at (413837): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.008047] hardirqs last disabled at (413842): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.008049] softirqs last enabled at (412744): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.008051] softirqs last disabled at (412727): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.008054] ---[ end trace 0000000000000000 ]--- <6> [394.008055] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.008123] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.008129] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.009383] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.009488] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.009589] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.009839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.009931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.010023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.010108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.010191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.010271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.010352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.010429] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.010523] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.010643] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.011675] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.021631] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.021881] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.022904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.022994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.023070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.023145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.023218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.023290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.023361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.023432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.023503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.023574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.023662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.023746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.023816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.023887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.023956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.024024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.024093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.024163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.024231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.024310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.024388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.024463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.024537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.024609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.024698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.024784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.024855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.024929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.025006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.025080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.025154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.025229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.025307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.025386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.025464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.025539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.025613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.025702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.025787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.025858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.025931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.026003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.026076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.026147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.026222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.026293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.026365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.026435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.026507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.026576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.026657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.026745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.026817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.026889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.026959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.027031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.027103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.027174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.027250] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.027399] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.027403] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87247, lrc_seqno=87247, guc_id=0, flags=0x73 in no process [-1] <7> [394.027405] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.027464] ------------[ cut here ]------------ <4> [394.027465] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.027466] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [394.027536] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.027603] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.027609] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.027612] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.027613] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.027614] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.027620] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.027710] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.027713] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.027717] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.027719] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.027722] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.027724] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.027726] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.027728] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.027731] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.027733] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.027736] PKRU: 55555554 <4> [394.027738] Call Trace: <4> [394.027740] <TASK> <4> [394.027748] ? lock_acquire+0x20/0x2f0 <4> [394.027757] ? lock_release+0xd0/0x2b0 <4> [394.027767] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.027777] process_one_work+0x239/0x760 <4> [394.027788] worker_thread+0x200/0x3f0 <4> [394.027793] ? __pfx_worker_thread+0x10/0x10 <4> [394.027797] kthread+0x10d/0x150 <4> [394.027801] ? __pfx_kthread+0x10/0x10 <4> [394.027807] ret_from_fork+0x3d4/0x480 <4> [394.027810] ? __pfx_kthread+0x10/0x10 <4> [394.027815] ret_from_fork_asm+0x1a/0x30 <4> [394.027829] </TASK> <4> [394.027830] irq event stamp: 1322945 <4> [394.027832] hardirqs last enabled at (1322951): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.027836] hardirqs last disabled at (1322956): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.027840] softirqs last enabled at (1321970): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.027844] softirqs last disabled at (1321959): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.027847] ---[ end trace 0000000000000000 ]--- <5> [394.028571] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87261, lrc_seqno=87261, guc_id=0, flags=0x73 in no process [-1] <7> [394.028615] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.028581] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.028657] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.028657] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.028679] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.028716] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.028723] ------------[ cut here ]------------ <4> [394.028726] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.028727] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.028738] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.028728] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:45/3610 <4> [394.028822] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.028907] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.028915] CPU: 4 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.028919] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.028920] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.028921] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.028931] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.029028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.029030] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.029033] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.029035] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.029037] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.029039] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.029040] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.029042] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.029045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.029046] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [394.029048] PKRU: 55555554 <4> [394.029050] Call Trace: <4> [394.029052] <TASK> <4> [394.029057] ? lock_acquire+0x20/0x2f0 <4> [394.029064] ? lock_release+0xd0/0x2b0 <4> [394.029070] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.029076] process_one_work+0x239/0x760 <4> [394.029083] worker_thread+0x200/0x3f0 <4> [394.029086] ? __pfx_worker_thread+0x10/0x10 <4> [394.029089] kthread+0x10d/0x150 <4> [394.029092] ? __pfx_kthread+0x10/0x10 <4> [394.029097] ret_from_fork+0x3d4/0x480 <4> [394.029099] ? __pfx_kthread+0x10/0x10 <4> [394.029102] ret_from_fork_asm+0x1a/0x30 <4> [394.029112] </TASK> <4> [394.029113] irq event stamp: 575791 <4> [394.029115] hardirqs last enabled at (575797): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.029119] hardirqs last disabled at (575802): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.029121] softirqs last enabled at (575024): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.029124] softirqs last disabled at (575019): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.029127] ---[ end trace 0000000000000000 ]--- <6> [394.029129] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.029200] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.029207] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.029302] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.029404] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.029507] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.029732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.029818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.029905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.029989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.030071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.030153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.030234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.030313] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.030406] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.030517] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.031535] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.041639] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.041913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.042927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.043004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.043077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.043151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.043223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.043294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.043365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.043436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.043505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.043575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.043681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.043763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.043833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.043903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.043974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.044045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.044117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.044188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.044258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.044337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.044414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.044488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.044562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.044640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.044727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.044801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.044874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.044950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.045025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.045099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.045173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.045246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.045325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.045403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.045483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.045560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.045644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.045729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.045801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.045871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.045945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.046017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.046088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.046158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.046232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.046302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.046373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.046442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.046512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.046581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.046659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.046746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.046817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.046888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.046957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.047028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.047097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.047166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.047237] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.047382] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.047386] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87261, lrc_seqno=87261, guc_id=0, flags=0x73 in no process [-1] <7> [394.047389] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.047446] ------------[ cut here ]------------ <4> [394.047447] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.047449] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <4> [394.047519] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.047577] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.047581] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.047584] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.047585] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.047586] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.047592] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.047673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.047676] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.047680] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.047683] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.047686] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.047688] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.047690] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.047692] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.047695] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.047698] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.047700] PKRU: 55555554 <4> [394.047703] Call Trace: <4> [394.047705] <TASK> <4> [394.047712] ? lock_acquire+0x20/0x2f0 <4> [394.047721] ? lock_release+0xd0/0x2b0 <4> [394.047730] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.047740] process_one_work+0x239/0x760 <4> [394.047751] worker_thread+0x200/0x3f0 <4> [394.047756] ? __pfx_worker_thread+0x10/0x10 <4> [394.047760] kthread+0x10d/0x150 <4> [394.047764] ? __pfx_kthread+0x10/0x10 <4> [394.047770] ret_from_fork+0x3d4/0x480 <4> [394.047773] ? __pfx_kthread+0x10/0x10 <4> [394.047779] ret_from_fork_asm+0x1a/0x30 <4> [394.047792] </TASK> <4> [394.047794] irq event stamp: 1326729 <4> [394.047796] hardirqs last enabled at (1326735): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.047800] hardirqs last disabled at (1326740): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.047804] softirqs last enabled at (1325454): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.047807] softirqs last disabled at (1325449): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.047811] ---[ end trace 0000000000000000 ]--- <6> [394.047814] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.047892] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.047898] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.049148] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.049252] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.049354] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.049572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.049674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.049765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.049850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.049932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.050012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.050094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.050172] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.050265] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.050377] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.051400] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.061649] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.061898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.062849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.062926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.063000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.063071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.063143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.063214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.063284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.063356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.063425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.063496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.063566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.063637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.063730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.063800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.063870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.063940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.064009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.064078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.064145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.064223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.064300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.064374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.064449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.064521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.064593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.064697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.064774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.064849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.064923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.064996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.065069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.065141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.065219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.065297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.065375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.065448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.065521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.065592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.065669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.065740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.065814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.065886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.065956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.066026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.066100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.066171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.066240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.066311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.066383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.066452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.066522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.066595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.066674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.066745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.066815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.066885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.066955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.067025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.067098] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.067247] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.067252] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87261, lrc_seqno=87261, guc_id=0, flags=0x73 in no process [-1] <7> [394.067254] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.067313] ------------[ cut here ]------------ <4> [394.067314] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.067316] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:55/3620 <4> [394.067387] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.067451] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.067456] CPU: 5 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.067459] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.067460] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.067461] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.067467] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.067535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.067537] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.067539] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.067540] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.067541] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.067542] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.067543] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.067545] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [394.067546] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.067547] CR2: 00007d287d0b8520 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.067549] PKRU: 55555554 <4> [394.067550] Call Trace: <4> [394.067551] <TASK> <4> [394.067555] ? lock_acquire+0x20/0x2f0 <4> [394.067561] ? lock_release+0xd0/0x2b0 <4> [394.067566] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.067571] process_one_work+0x239/0x760 <4> [394.067577] worker_thread+0x200/0x3f0 <4> [394.067580] ? __pfx_worker_thread+0x10/0x10 <4> [394.067582] kthread+0x10d/0x150 <4> [394.067585] ? __pfx_kthread+0x10/0x10 <4> [394.067588] ret_from_fork+0x3d4/0x480 <4> [394.067590] ? __pfx_kthread+0x10/0x10 <4> [394.067594] ret_from_fork_asm+0x1a/0x30 <4> [394.067601] </TASK> <4> [394.067602] irq event stamp: 417373 <4> [394.067603] hardirqs last enabled at (417379): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.067605] hardirqs last disabled at (417384): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.067607] softirqs last enabled at (416318): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.067610] softirqs last disabled at (416311): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.067612] ---[ end trace 0000000000000000 ]--- <5> [394.068216] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87275, lrc_seqno=87275, guc_id=0, flags=0x73 in no process [-1] <7> [394.068254] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.068224] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.068342] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.068374] ------------[ cut here ]------------ <4> [394.068377] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.068377] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.068411] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.068411] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.068380] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:45/3610 <7> [394.068482] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.068512] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.068585] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.068592] CPU: 7 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.068597] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.068598] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.068601] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.068610] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.068732] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.068735] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.068738] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.068740] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.068743] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.068745] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.068748] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.068749] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.068752] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.068754] CR2: 00007021e33f8000 CR3: 000000012c104004 CR4: 0000000000f72ef0 <4> [394.068756] PKRU: 55555554 <4> [394.068758] Call Trace: <4> [394.068760] <TASK> <4> [394.068766] ? lock_acquire+0x20/0x2f0 <4> [394.068775] ? lock_release+0xd0/0x2b0 <4> [394.068781] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.068788] process_one_work+0x239/0x760 <4> [394.068795] worker_thread+0x200/0x3f0 <4> [394.068798] ? __pfx_worker_thread+0x10/0x10 <4> [394.068802] kthread+0x10d/0x150 <4> [394.068807] ? __pfx_kthread+0x10/0x10 <4> [394.068811] ret_from_fork+0x3d4/0x480 <4> [394.068814] ? __pfx_kthread+0x10/0x10 <4> [394.068818] ret_from_fork_asm+0x1a/0x30 <4> [394.068826] </TASK> <4> [394.068828] irq event stamp: 577809 <4> [394.068830] hardirqs last enabled at (577815): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.068834] hardirqs last disabled at (577820): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.068837] softirqs last enabled at (577648): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.068840] softirqs last disabled at (577633): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.068842] ---[ end trace 0000000000000000 ]--- <6> [394.068845] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.068933] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.068941] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.069000] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.069048] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.069153] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.069257] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.069671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.069764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.069856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.069939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.070020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.070100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.070183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.070259] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.070352] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.070465] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.071493] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.082215] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.082465] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.083739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.083815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.083887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.083959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.084031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.084104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.084174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.084246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.084315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.084386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.084456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.084526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.084597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.084676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.084747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.084816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.084885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.084953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.085024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.085103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.085180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.085254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.085327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.085399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.085471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.085541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.085611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.085696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.085770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.085841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.085913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.085987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.086064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.086141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.086219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.086295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.086367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.086439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.086511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.086580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.086656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.086728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.086798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.086868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.086944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.087016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.087089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.087160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.087231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.087300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.087369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.087439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.087509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.087580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.087653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.087725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.087794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.087861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.087933] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.088081] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.088085] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87275, lrc_seqno=87275, guc_id=0, flags=0x73 in no process [-1] <7> [394.088088] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.088145] ------------[ cut here ]------------ <4> [394.088146] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.088147] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:55/3620 <4> [394.088217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.088275] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.088280] CPU: 4 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.088283] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.088284] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.088286] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.088291] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.088358] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.088360] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.088363] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.088364] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.088366] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.088367] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.088368] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.088370] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.088372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.088373] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [394.088375] PKRU: 55555554 <4> [394.088376] Call Trace: <4> [394.088378] <TASK> <4> [394.088382] ? lock_acquire+0x20/0x2f0 <4> [394.088388] ? lock_release+0xd0/0x2b0 <4> [394.088393] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.088399] process_one_work+0x239/0x760 <4> [394.088405] worker_thread+0x200/0x3f0 <4> [394.088408] ? __pfx_worker_thread+0x10/0x10 <4> [394.088410] kthread+0x10d/0x150 <4> [394.088413] ? __pfx_kthread+0x10/0x10 <4> [394.088417] ret_from_fork+0x3d4/0x480 <4> [394.088419] ? __pfx_kthread+0x10/0x10 <4> [394.088422] ret_from_fork_asm+0x1a/0x30 <4> [394.088429] </TASK> <4> [394.088431] irq event stamp: 421397 <4> [394.088432] hardirqs last enabled at (421403): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.088435] hardirqs last disabled at (421408): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.088437] softirqs last enabled at (420148): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.088440] softirqs last disabled at (420143): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.088442] ---[ end trace 0000000000000000 ]--- <6> [394.088444] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.088513] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.088519] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.088924] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.089136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.089218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.089304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.089385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.089463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.089542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.089621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.089710] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.089802] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.089913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.090921] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.100662] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.100910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.101950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.102028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.102101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.102174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.102247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.102319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.102389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.102459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.102530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.102601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.102675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.102747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.102814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.102884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.102954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.103022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.103090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.103158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.103226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.103303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.103378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.103450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.103524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.103595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.103672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.103743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.103814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.103886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.103960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.104033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.104105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.104176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.104255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.104335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.104413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.104488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.104562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.104633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.104714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.104786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.104861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.104934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.105005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.105073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.105146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.105217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.105288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.105357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.105428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.105495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.105564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.105634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.105713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.105783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.105850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.105923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.105991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.106060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.106133] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.106286] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.106290] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87275, lrc_seqno=87275, guc_id=0, flags=0x73 in no process [-1] <7> [394.106292] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.106349] ------------[ cut here ]------------ <4> [394.106350] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.106352] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:55/3620 <4> [394.106421] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.106479] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.106483] CPU: 4 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.106486] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.106487] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.106488] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.106493] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.106561] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.106562] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.106564] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.106566] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.106567] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.106568] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.106569] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.106570] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.106572] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.106573] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [394.106574] PKRU: 55555554 <4> [394.106575] Call Trace: <4> [394.106576] <TASK> <4> [394.106580] ? lock_acquire+0x20/0x2f0 <4> [394.106585] ? lock_release+0xd0/0x2b0 <4> [394.106590] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.106596] process_one_work+0x239/0x760 <4> [394.106602] worker_thread+0x200/0x3f0 <4> [394.106604] ? __pfx_worker_thread+0x10/0x10 <4> [394.106606] kthread+0x10d/0x150 <4> [394.106609] ? __pfx_kthread+0x10/0x10 <4> [394.106612] ret_from_fork+0x3d4/0x480 <4> [394.106614] ? __pfx_kthread+0x10/0x10 <4> [394.106617] ret_from_fork_asm+0x1a/0x30 <4> [394.106625] </TASK> <4> [394.106626] irq event stamp: 424749 <4> [394.106627] hardirqs last enabled at (424755): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.106629] hardirqs last disabled at (424760): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.106631] softirqs last enabled at (423790): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.106633] softirqs last disabled at (423781): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.106635] ---[ end trace 0000000000000000 ]--- <5> [394.107001] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87289, lrc_seqno=87289, guc_id=0, flags=0x73 in no process [-1] <7> [394.107052] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.107007] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.107112] ------------[ cut here ]------------ <4> [394.107114] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.107116] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:65/3630 <7> [394.107181] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.107191] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.107196] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr <7> [394.107216] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.107218] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.107225] intel_rapl_common <4> [394.107228] intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.107298] CPU: 0 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.107302] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.107304] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.107306] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.107316] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.107399] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.107401] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.107405] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.107407] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.107409] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.107411] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.107412] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.107415] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.107417] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.107419] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.107421] PKRU: 55555554 <4> [394.107423] Call Trace: <4> [394.107425] <TASK> <4> [394.107430] ? lock_acquire+0x20/0x2f0 <4> [394.107437] ? lock_release+0xd0/0x2b0 <4> [394.107443] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.107449] process_one_work+0x239/0x760 <4> [394.107457] worker_thread+0x200/0x3f0 <4> [394.107460] ? __pfx_worker_thread+0x10/0x10 <4> [394.107463] kthread+0x10d/0x150 <4> [394.107467] ? __pfx_kthread+0x10/0x10 <4> [394.107470] ret_from_fork+0x3d4/0x480 <4> [394.107472] ? __pfx_kthread+0x10/0x10 <4> [394.107476] ret_from_fork_asm+0x1a/0x30 <4> [394.107484] </TASK> <4> [394.107485] irq event stamp: 149327 <4> [394.107487] hardirqs last enabled at (149333): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.107490] hardirqs last disabled at (149338): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.107493] softirqs last enabled at (148134): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.107496] softirqs last disabled at (148132): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.107500] ---[ end trace 0000000000000000 ]--- <6> [394.107503] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.107582] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.107590] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.107681] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.107746] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.107820] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.107785] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.107890] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.108103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.108189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.108276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.108358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.108439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.108518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.108597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.108681] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.108773] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.108885] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.109892] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.119672] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.119921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.120942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.121019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.121092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.121166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.121239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.121311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.121383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.121454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.121525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.121595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.121671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.121742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.121809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.121878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.121948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.122016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.122085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.122155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.122223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.122301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.122377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.122451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.122525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.122597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.122675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.122747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.122819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.122894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.122971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.123046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.123120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.123193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.123271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.123348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.123426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.123499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.123572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.123642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.123727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.123798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.123871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.123942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.124011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.124079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.124151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.124220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.124289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.124356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.124426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.124495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.124563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.124636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.124717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.124788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.124856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.124925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.124994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.125063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.125134] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.125285] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.125289] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87289, lrc_seqno=87289, guc_id=0, flags=0x73 in no process [-1] <7> [394.125292] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.125697] ------------[ cut here ]------------ <4> [394.125699] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.125702] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:55/3620 <4> [394.126401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.126537] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.126552] CPU: 4 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.126560] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.126563] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.126565] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.126586] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.126880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.126882] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.126885] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.126886] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.126887] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.126889] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.126890] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.126891] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.126892] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.126894] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [394.126895] PKRU: 55555554 <4> [394.126897] Call Trace: <4> [394.126898] <TASK> <4> [394.126902] ? lock_acquire+0x20/0x2f0 <4> [394.126908] ? lock_release+0xd0/0x2b0 <4> [394.126914] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.126920] process_one_work+0x239/0x760 <4> [394.126926] worker_thread+0x200/0x3f0 <4> [394.126929] ? __pfx_worker_thread+0x10/0x10 <4> [394.126931] kthread+0x10d/0x150 <4> [394.126934] ? __pfx_kthread+0x10/0x10 <4> [394.126938] ret_from_fork+0x3d4/0x480 <4> [394.126939] ? __pfx_kthread+0x10/0x10 <4> [394.126942] ret_from_fork_asm+0x1a/0x30 <4> [394.126950] </TASK> <4> [394.126951] irq event stamp: 428309 <4> [394.126952] hardirqs last enabled at (428315): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.126955] hardirqs last disabled at (428320): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.126958] softirqs last enabled at (428148): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.126962] softirqs last disabled at (428141): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.126965] ---[ end trace 0000000000000000 ]--- <6> [394.126968] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [394.126974] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [394.127082] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.127092] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.127118] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.127263] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.127478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.127565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.127655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.127756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.127839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.127922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.128003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.128080] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.128172] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.128285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.129292] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.140018] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.140266] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.141262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.141339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.141413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.141487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.141560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.141633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.141717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.141790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.141861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.141933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.142004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.142075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.142146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.142217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.142287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.142356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.142425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.142494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.142564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.142642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.142732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.142807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.142881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.142952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.143024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.143094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.143164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.143238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.143312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.143384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.143458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.143532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.143610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.143692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.143771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.143845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.143918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.143989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.144061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.144131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.144223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.144295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.144366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.144436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.144510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.144581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.144652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.144733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.144805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.144875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.144944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.145017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.145088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.145158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.145227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.145300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.145372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.145444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.145518] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.145666] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.145670] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87289, lrc_seqno=87289, guc_id=0, flags=0x73 in no process [-1] <7> [394.145677] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.145736] ------------[ cut here ]------------ <4> [394.145737] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.145738] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:55/3620 <4> [394.145809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.145867] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.145872] CPU: 4 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.145875] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.145876] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.145877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.145882] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.145950] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.145952] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.145954] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.145955] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.145956] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.145957] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.145958] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.145960] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.145961] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.145962] CR2: 00007021e5a09b40 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [394.145964] PKRU: 55555554 <4> [394.145965] Call Trace: <4> [394.145966] <TASK> <4> [394.145969] ? lock_acquire+0x20/0x2f0 <4> [394.145975] ? lock_release+0xd0/0x2b0 <4> [394.145980] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.145985] process_one_work+0x239/0x760 <4> [394.145991] worker_thread+0x200/0x3f0 <4> [394.145994] ? __pfx_worker_thread+0x10/0x10 <4> [394.145996] kthread+0x10d/0x150 <4> [394.145999] ? __pfx_kthread+0x10/0x10 <4> [394.146003] ret_from_fork+0x3d4/0x480 <4> [394.146004] ? __pfx_kthread+0x10/0x10 <4> [394.146007] ret_from_fork_asm+0x1a/0x30 <4> [394.146015] </TASK> <4> [394.146016] irq event stamp: 431637 <4> [394.146017] hardirqs last enabled at (431643): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.146019] hardirqs last disabled at (431648): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.146021] softirqs last enabled at (430444): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.146024] softirqs last disabled at (430435): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.146026] ---[ end trace 0000000000000000 ]--- <5> [394.146646] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87303, lrc_seqno=87303, guc_id=0, flags=0x73 in no process [-1] <7> [394.146651] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.146737] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.146747] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.146789] ------------[ cut here ]------------ <4> [394.146792] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.146790] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.146798] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.146814] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.146837] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.146794] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:65/3630 <4> [394.146907] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.147000] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.147008] CPU: 0 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.147012] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.147014] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.147016] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.147022] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.147103] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.147105] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.147109] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.147111] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.147112] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.147114] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.147115] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.147117] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.147118] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.147120] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.147123] PKRU: 55555554 <4> [394.147138] Call Trace: <4> [394.147139] <TASK> <4> [394.147145] ? lock_acquire+0x20/0x2f0 <4> [394.147151] ? lock_release+0xd0/0x2b0 <4> [394.147158] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.147164] process_one_work+0x239/0x760 <4> [394.147170] worker_thread+0x200/0x3f0 <4> [394.147173] ? __pfx_worker_thread+0x10/0x10 <4> [394.147176] kthread+0x10d/0x150 <4> [394.147179] ? __pfx_kthread+0x10/0x10 <4> [394.147182] ret_from_fork+0x3d4/0x480 <4> [394.147185] ? __pfx_kthread+0x10/0x10 <4> [394.147188] ret_from_fork_asm+0x1a/0x30 <4> [394.147196] </TASK> <4> [394.147198] irq event stamp: 151923 <4> [394.147199] hardirqs last enabled at (151929): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.147202] hardirqs last disabled at (151934): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.147204] softirqs last enabled at (150726): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.147207] softirqs last disabled at (150724): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.147209] ---[ end trace 0000000000000000 ]--- <6> [394.147211] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.147287] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.147300] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.147611] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.147726] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.147836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.148111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.148246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.148384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.148516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.148646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.148786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.148917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.149045] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.149184] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.149346] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.150266] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.150612] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.160691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.160953] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.161966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.162048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.162154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.162235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.162317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.162390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.162470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.162542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.162614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.162691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.162762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.162832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.162902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.162998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.163079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.163157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.163230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.163308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.163378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.163458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.163537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.163613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.163697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.163770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.163843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.163936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.164025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.164102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.164187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.164263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.164347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.164422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.164503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.164582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.164660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.164749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.164850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.164922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.165002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.165072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.165152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.165225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.165297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.165366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.165439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.165510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.165580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.165668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.165774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.165852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.165923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.165996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.166075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.166147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.166216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.166287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.166357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.166426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.166511] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.166660] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.166665] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87303, lrc_seqno=87303, guc_id=0, flags=0x73 in no process [-1] <7> [394.166668] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.166756] ------------[ cut here ]------------ <4> [394.166758] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.166759] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:55/3620 <4> [394.166830] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.166900] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.166906] CPU: 4 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.166909] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.166910] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.166912] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.166917] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.166987] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.166989] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.166991] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.166993] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.166994] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.166995] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.166997] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.166998] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.167000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.167001] CR2: 00007021e5a09b40 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [394.167003] PKRU: 55555554 <4> [394.167004] Call Trace: <4> [394.167006] <TASK> <4> [394.167010] ? lock_acquire+0x20/0x2f0 <4> [394.167016] ? lock_release+0xd0/0x2b0 <4> [394.167021] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.167027] process_one_work+0x239/0x760 <4> [394.167034] worker_thread+0x200/0x3f0 <4> [394.167037] ? __pfx_worker_thread+0x10/0x10 <4> [394.167039] kthread+0x10d/0x150 <4> [394.167042] ? __pfx_kthread+0x10/0x10 <4> [394.167046] ret_from_fork+0x3d4/0x480 <4> [394.167048] ? __pfx_kthread+0x10/0x10 <4> [394.167051] ret_from_fork_asm+0x1a/0x30 <4> [394.167059] </TASK> <4> [394.167060] irq event stamp: 435317 <4> [394.167061] hardirqs last enabled at (435323): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.167064] hardirqs last disabled at (435328): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.167067] softirqs last enabled at (434550): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.167069] softirqs last disabled at (434545): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.167072] ---[ end trace 0000000000000000 ]--- <6> [394.167074] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.167144] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.167150] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.167560] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.167784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.167879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.167970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.168053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.168135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.168245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.168328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.168415] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.168507] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.168626] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.169649] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.179697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.179948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.180957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.181048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.181156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.181241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.181318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.181396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.181470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.181543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.181619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.181696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.181784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.181873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.181956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.182034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.182109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.182184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.182257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.182330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.182401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.182482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.182561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.182635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.182757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.182830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.182901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.182972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.183043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.183117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.183191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.183262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.183334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.183408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.183485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.183564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.183648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.183770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.183847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.183920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.183991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.184062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.184136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.184206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.184276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.184346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.184420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.184489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.184559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.184628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.184702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.184772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.184843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.184917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.184989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.185062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.185131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.185203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.185272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.185341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.185413] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.185566] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.185571] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87303, lrc_seqno=87303, guc_id=0, flags=0x73 in no process [-1] <7> [394.185573] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.185632] ------------[ cut here ]------------ <4> [394.185633] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.185634] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:55/3620 <4> [394.185708] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.185773] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.185779] CPU: 7 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.185782] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.185783] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.185785] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.185790] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.185859] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.185861] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.185863] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.185865] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.185866] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.185868] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.185869] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.185870] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.185872] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.185874] CR2: 00007021e33f8000 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [394.185875] PKRU: 55555554 <4> [394.185877] Call Trace: <4> [394.185878] <TASK> <4> [394.185882] ? lock_acquire+0x20/0x2f0 <4> [394.185888] ? lock_release+0xd0/0x2b0 <4> [394.185893] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.185899] process_one_work+0x239/0x760 <4> [394.185906] worker_thread+0x200/0x3f0 <4> [394.185909] ? __pfx_worker_thread+0x10/0x10 <4> [394.185911] kthread+0x10d/0x150 <4> [394.185914] ? __pfx_kthread+0x10/0x10 <4> [394.185918] ret_from_fork+0x3d4/0x480 <4> [394.185920] ? __pfx_kthread+0x10/0x10 <4> [394.185923] ret_from_fork_asm+0x1a/0x30 <4> [394.185931] </TASK> <4> [394.185932] irq event stamp: 438969 <4> [394.185933] hardirqs last enabled at (438975): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.185937] hardirqs last disabled at (438980): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.185939] softirqs last enabled at (437884): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.185942] softirqs last disabled at (437851): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.185944] ---[ end trace 0000000000000000 ]--- <5> [394.186531] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87317, lrc_seqno=87317, guc_id=0, flags=0x73 in no process [-1] <7> [394.186536] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.186591] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186630] ------------[ cut here ]------------ <4> [394.186631] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.186633] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:65/3630 <4> [394.186726] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb <7> [394.186729] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186735] mei_gsc mtd_intel_dg xe drm_gpuvm <7> [394.186732] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186743] drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer <7> [394.186792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186799] snd <4> [394.186801] i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class <7> [394.186805] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186812] intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad <7> [394.186814] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186818] acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.186829] CPU: 0 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.186832] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.186833] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <7> [394.186830] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.186834] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.186843] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.186938] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.186940] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.186944] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.186945] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.186946] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.186948] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.186949] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.186951] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.186952] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.186954] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.186955] PKRU: 55555554 <4> [394.186956] Call Trace: <4> [394.186958] <TASK> <4> [394.186962] ? lock_acquire+0x20/0x2f0 <4> [394.186968] ? lock_release+0xd0/0x2b0 <4> [394.186974] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.186979] process_one_work+0x239/0x760 <4> [394.186986] worker_thread+0x200/0x3f0 <4> [394.186988] ? __pfx_worker_thread+0x10/0x10 <4> [394.186990] kthread+0x10d/0x150 <4> [394.186993] ? __pfx_kthread+0x10/0x10 <4> [394.186997] ret_from_fork+0x3d4/0x480 <4> [394.186999] ? __pfx_kthread+0x10/0x10 <4> [394.187002] ret_from_fork_asm+0x1a/0x30 <4> [394.187009] </TASK> <4> [394.187010] irq event stamp: 153929 <4> [394.187012] hardirqs last enabled at (153935): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.187016] hardirqs last disabled at (153940): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.187018] softirqs last enabled at (153176): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.187020] softirqs last disabled at (153171): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.187022] ---[ end trace 0000000000000000 ]--- <6> [394.187025] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.187101] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.187155] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.187331] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.187440] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.187542] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.187763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.187855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.187945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.188031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.188114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.188198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.188283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.188361] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.188453] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.188566] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.189577] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.199705] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.199954] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.200948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.201025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.201099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.201172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.201245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.201317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.201389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.201460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.201530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.201599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.201668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.201754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.201837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.201906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.201976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.202045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.202114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.202184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.202251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.202330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.202407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.202480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.202553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.202625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.202701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.202788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.202859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.202933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.203007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.203079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.203151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.203224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.203304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.203382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.203461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.203537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.203611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.203682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.203769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.203853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.203926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.203997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.204067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.204136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.204210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.204278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.204347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.204416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.204487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.204559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.204631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.204712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.204795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.204866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.204936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.205005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.205075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.205141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.205211] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.205354] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.205358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87317, lrc_seqno=87317, guc_id=0, flags=0x73 in no process [-1] <7> [394.205360] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.205418] ------------[ cut here ]------------ <4> [394.205419] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.205420] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:65/3630 <4> [394.205490] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.205547] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.205552] CPU: 0 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.205555] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.205556] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.205557] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.205562] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.205630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.205632] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.205634] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.205636] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.205637] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.205639] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.205640] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.205641] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.205643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.205645] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.205646] PKRU: 55555554 <4> [394.205648] Call Trace: <4> [394.205649] <TASK> <4> [394.205653] ? lock_acquire+0x20/0x2f0 <4> [394.205658] ? lock_release+0xd0/0x2b0 <4> [394.205664] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.205669] process_one_work+0x239/0x760 <4> [394.205676] worker_thread+0x200/0x3f0 <4> [394.205678] ? __pfx_worker_thread+0x10/0x10 <4> [394.205681] kthread+0x10d/0x150 <4> [394.205684] ? __pfx_kthread+0x10/0x10 <4> [394.205687] ret_from_fork+0x3d4/0x480 <4> [394.205689] ? __pfx_kthread+0x10/0x10 <4> [394.205693] ret_from_fork_asm+0x1a/0x30 <4> [394.205709] </TASK> <4> [394.205711] irq event stamp: 157341 <4> [394.205713] hardirqs last enabled at (157347): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.205717] hardirqs last disabled at (157352): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.205721] softirqs last enabled at (156074): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.205724] softirqs last disabled at (156065): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.205728] ---[ end trace 0000000000000000 ]--- <6> [394.205731] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.205821] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.205827] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.206235] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.206448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.206536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.206625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.206716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.206807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.206887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.206966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.207044] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.207135] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.207247] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.208259] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.218713] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.218963] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.220001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.220094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.220174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.220248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.220319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.220390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.220462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.220533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.220602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.220670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.220760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.220841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.220912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.220984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.221056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.221126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.221197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.221267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.221336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.221416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.221493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.221567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.221642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.221723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.221812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.221884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.221955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.222028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.222102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.222173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.222246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.222316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.222392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.222468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.222546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.222620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.222693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.222781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.222867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.222937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.223010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.223082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.223153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.223223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.223296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.223366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.223435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.223503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.223573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.223642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.223716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.223801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.223872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.223942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.224012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.224083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.224152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.224221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.224293] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.224444] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.224448] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87317, lrc_seqno=87317, guc_id=0, flags=0x73 in no process [-1] <7> [394.224451] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.224508] ------------[ cut here ]------------ <4> [394.224509] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.224510] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:65/3630 <4> [394.224581] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.224639] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.224644] CPU: 0 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.224646] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.224647] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.224649] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.224654] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.224729] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.224732] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.224736] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.224739] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.224741] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.224743] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.224746] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.224748] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.224751] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.224753] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.224756] PKRU: 55555554 <4> [394.224758] Call Trace: <4> [394.224760] <TASK> <4> [394.224767] ? lock_acquire+0x20/0x2f0 <4> [394.224776] ? lock_release+0xd0/0x2b0 <4> [394.224786] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.224796] process_one_work+0x239/0x760 <4> [394.224807] worker_thread+0x200/0x3f0 <4> [394.224812] ? __pfx_worker_thread+0x10/0x10 <4> [394.224816] kthread+0x10d/0x150 <4> [394.224820] ? __pfx_kthread+0x10/0x10 <4> [394.224826] ret_from_fork+0x3d4/0x480 <4> [394.224830] ? __pfx_kthread+0x10/0x10 <4> [394.224835] ret_from_fork_asm+0x1a/0x30 <4> [394.224849] </TASK> <4> [394.224851] irq event stamp: 160657 <4> [394.224853] hardirqs last enabled at (160663): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.224857] hardirqs last disabled at (160668): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.224861] softirqs last enabled at (159482): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.224864] softirqs last disabled at (159475): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.224868] ---[ end trace 0000000000000000 ]--- <5> [394.226512] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87331, lrc_seqno=87331, guc_id=0, flags=0x73 in no process [-1] <7> [394.226542] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.226499] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.226556] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.226557] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.226518] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.226611] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.226665] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.226679] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.226700] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.226717] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.226745] ------------[ cut here ]------------ <4> [394.226747] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.226750] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:55/3620 <4> [394.226828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.226900] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.226906] CPU: 7 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.226909] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.226910] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.226912] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.226918] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.226989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.226990] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.226993] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.226994] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.226995] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.226996] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.226998] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.226999] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.227000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.227001] CR2: 00007021e33f8000 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [394.227003] PKRU: 55555554 <4> [394.227004] Call Trace: <4> [394.227005] <TASK> <4> [394.227009] ? lock_acquire+0x20/0x2f0 <4> [394.227014] ? lock_release+0xd0/0x2b0 <4> [394.227019] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.227025] process_one_work+0x239/0x760 <4> [394.227031] worker_thread+0x200/0x3f0 <4> [394.227033] ? __pfx_worker_thread+0x10/0x10 <4> [394.227035] kthread+0x10d/0x150 <4> [394.227038] ? __pfx_kthread+0x10/0x10 <4> [394.227042] ret_from_fork+0x3d4/0x480 <4> [394.227043] ? __pfx_kthread+0x10/0x10 <4> [394.227047] ret_from_fork_asm+0x1a/0x30 <4> [394.227054] </TASK> <4> [394.227055] irq event stamp: 441241 <4> [394.227056] hardirqs last enabled at (441247): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.227059] hardirqs last disabled at (441252): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.227061] softirqs last enabled at (440020): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.227063] softirqs last disabled at (440018): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.227065] ---[ end trace 0000000000000000 ]--- <6> [394.227067] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.227136] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.227143] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.227550] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.227782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.227924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.228062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.228202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.228295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.228381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.228466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.228547] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.228640] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.228762] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.229773] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.239719] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.239969] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.240952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.241047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.241131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.241210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.241287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.241365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.241442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.241518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.241596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.241673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.241764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.241839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.241914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.241988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.242061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.242134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.242208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.242281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.242354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.242439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.242521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.242603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.242681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.242767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.242843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.242918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.242993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.243069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.243146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.243221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.243297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.243372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.243454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.243533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.243615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.243694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.243782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.243859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.243933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.244006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.244082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.244156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.244230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.244302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.244380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.244455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.244530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.244607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.244686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.244768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.244843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.244921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.244996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.245071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.245146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.245221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.245296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.245370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.245447] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.245582] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.245587] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87331, lrc_seqno=87331, guc_id=0, flags=0x73 in no process [-1] <7> [394.245589] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.245650] ------------[ cut here ]------------ <4> [394.245651] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.245653] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:65/3630 <4> [394.245734] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.245807] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.245813] CPU: 10 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.245816] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.245818] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.245819] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.245825] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.245898] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.245900] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.245902] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.245903] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.245904] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.245906] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.245907] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.245908] FS: 0000000000000000(0000) GS:ffff8888db198000(0000) knlGS:0000000000000000 <4> [394.245909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.245910] CR2: 000000062b4df000 CR3: 000000012c104001 CR4: 0000000000f72ef0 <4> [394.245912] PKRU: 55555554 <4> [394.245913] Call Trace: <4> [394.245914] <TASK> <4> [394.245918] ? lock_acquire+0x20/0x2f0 <4> [394.245923] ? lock_release+0xd0/0x2b0 <4> [394.245928] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.245934] process_one_work+0x239/0x760 <4> [394.245940] worker_thread+0x200/0x3f0 <4> [394.245943] ? __pfx_worker_thread+0x10/0x10 <4> [394.245945] kthread+0x10d/0x150 <4> [394.245948] ? __pfx_kthread+0x10/0x10 <4> [394.245952] ret_from_fork+0x3d4/0x480 <4> [394.245954] ? __pfx_kthread+0x10/0x10 <4> [394.245957] ret_from_fork_asm+0x1a/0x30 <4> [394.245965] </TASK> <4> [394.245966] irq event stamp: 164529 <4> [394.245967] hardirqs last enabled at (164535): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.245969] hardirqs last disabled at (164540): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.245972] softirqs last enabled at (163780): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.245974] softirqs last disabled at (163767): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.245976] ---[ end trace 0000000000000000 ]--- <6> [394.245978] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.246052] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.246091] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.246497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.246722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.246810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.246899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.246986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.247071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.247154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.247238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.247319] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.247417] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.247535] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.248545] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.258727] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.258979] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.260142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.260225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.260303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.260379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.260456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.260532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.260608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.260682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.260766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.260840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.260913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.260987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.261060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.261134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.261208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.261281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.261355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.261428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.261503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.261587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.261668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.261753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.261833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.261909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.261986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.262060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.262136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.262213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.262291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.262367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.262445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.262522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.262605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.262686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.262778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.262859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.262938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.263014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.263090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.263165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.263244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.263320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.263397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.263472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.263550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.263625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.263702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.263784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.263859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.263933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.264007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.264083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.264159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.264238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.264314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.264392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.264466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.264540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.264617] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.264775] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.264779] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87331, lrc_seqno=87331, guc_id=0, flags=0x73 in no process [-1] <7> [394.264782] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.264843] ------------[ cut here ]------------ <4> [394.264844] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.264846] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:65/3630 <4> [394.264921] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.264979] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.264984] CPU: 10 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.264986] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.264987] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.264989] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.264994] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.265066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.265068] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.265070] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.265071] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.265072] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.265073] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.265074] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.265076] FS: 0000000000000000(0000) GS:ffff8888db198000(0000) knlGS:0000000000000000 <4> [394.265077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.265078] CR2: 000000062b4df000 CR3: 000000012c104001 CR4: 0000000000f72ef0 <4> [394.265080] PKRU: 55555554 <4> [394.265081] Call Trace: <4> [394.265082] <TASK> <4> [394.265085] ? lock_acquire+0x20/0x2f0 <4> [394.265091] ? lock_release+0xd0/0x2b0 <4> [394.265096] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.265101] process_one_work+0x239/0x760 <4> [394.265107] worker_thread+0x200/0x3f0 <4> [394.265110] ? __pfx_worker_thread+0x10/0x10 <4> [394.265112] kthread+0x10d/0x150 <4> [394.265115] ? __pfx_kthread+0x10/0x10 <4> [394.265118] ret_from_fork+0x3d4/0x480 <4> [394.265120] ? __pfx_kthread+0x10/0x10 <4> [394.265123] ret_from_fork_asm+0x1a/0x30 <4> [394.265130] </TASK> <4> [394.265131] irq event stamp: 167941 <4> [394.265132] hardirqs last enabled at (167947): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.265135] hardirqs last disabled at (167952): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.265137] softirqs last enabled at (166850): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.265139] softirqs last disabled at (166843): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.265141] ---[ end trace 0000000000000000 ]--- <7> [394.265673] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.265738] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.265771] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.265771] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.265845] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.265845] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.265859] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [394.266603] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87345, lrc_seqno=87345, guc_id=0, flags=0x73 in no process [-1] <7> [394.266606] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.266672] ------------[ cut here ]------------ <4> [394.266673] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.266674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:65/3630 <4> [394.266749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.266807] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.266812] CPU: 10 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.266814] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.266815] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.266817] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.266821] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.266889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.266891] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.266893] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.266894] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.266895] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.266897] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.266898] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.266899] FS: 0000000000000000(0000) GS:ffff8888db198000(0000) knlGS:0000000000000000 <4> [394.266901] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.266903] CR2: 000000062b4df000 CR3: 000000012c104001 CR4: 0000000000f72ef0 <4> [394.266904] PKRU: 55555554 <4> [394.266905] Call Trace: <4> [394.266906] <TASK> <4> [394.266910] ? lock_acquire+0x20/0x2f0 <4> [394.266916] ? lock_release+0xd0/0x2b0 <4> [394.266921] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.266926] process_one_work+0x239/0x760 <4> [394.266933] worker_thread+0x200/0x3f0 <4> [394.266935] ? __pfx_worker_thread+0x10/0x10 <4> [394.266938] kthread+0x10d/0x150 <4> [394.266941] ? __pfx_kthread+0x10/0x10 <4> [394.266944] ret_from_fork+0x3d4/0x480 <4> [394.266947] ? __pfx_kthread+0x10/0x10 <4> [394.266950] ret_from_fork_asm+0x1a/0x30 <4> [394.266957] </TASK> <4> [394.266959] irq event stamp: 169209 <4> [394.266960] hardirqs last enabled at (169215): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.266962] hardirqs last disabled at (169220): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.266965] softirqs last enabled at (168460): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.266967] softirqs last disabled at (168455): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.266969] ---[ end trace 0000000000000000 ]--- <7> [394.266983] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.267087] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [394.267182] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.267253] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.267262] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.267671] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.268286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.268383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.268484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.268573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.268659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.268745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.268828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.268910] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.269030] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.269142] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.270172] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.280738] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.280987] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.281997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.282092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.282192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.282268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.282348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.282421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.282500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.282572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.282644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.282715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.282815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.282888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.282994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.283065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.283143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.283214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.283291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.283362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.283432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.283512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.283588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.283675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.283772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.283852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.283925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.284001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.284074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.284150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.284224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.284299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.284404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.284482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.284569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.284650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.284741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.284819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.284893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.284965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.285037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.285106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.285196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.285293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.285366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.285444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.285520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.285600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.285671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.285746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.285817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.285884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.285975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.286059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.286138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.286210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.286285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.286357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.286426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.286496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.286569] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.286726] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.287591] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87345, lrc_seqno=87345, guc_id=0, flags=0x73 in no process [-1] <7> [394.287595] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.287666] ------------[ cut here ]------------ <4> [394.287668] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.287670] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:42/3607 <4> [394.287778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.287849] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.287855] CPU: 4 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.287858] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.287859] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.287860] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.287865] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.287937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.287939] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.287941] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.287942] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.287943] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.287944] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.287945] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.287947] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.287948] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.287949] CR2: 00007021e5a09b40 CR3: 00000001e2d1a004 CR4: 0000000000f72ef0 <4> [394.287951] PKRU: 55555554 <4> [394.287952] Call Trace: <4> [394.287953] <TASK> <4> [394.287957] ? lock_acquire+0x20/0x2f0 <4> [394.287963] ? lock_release+0xd0/0x2b0 <4> [394.287968] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.287973] process_one_work+0x239/0x760 <4> [394.287980] worker_thread+0x200/0x3f0 <4> [394.287982] ? __pfx_worker_thread+0x10/0x10 <4> [394.287984] kthread+0x10d/0x150 <4> [394.287987] ? __pfx_kthread+0x10/0x10 <4> [394.287991] ret_from_fork+0x3d4/0x480 <4> [394.287993] ? __pfx_kthread+0x10/0x10 <4> [394.287998] ret_from_fork_asm+0x1a/0x30 <4> [394.288012] </TASK> <4> [394.288013] irq event stamp: 419267 <4> [394.288014] hardirqs last enabled at (419273): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.288017] hardirqs last disabled at (419278): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.288019] softirqs last enabled at (418518): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.288021] softirqs last disabled at (418487): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.288024] ---[ end trace 0000000000000000 ]--- <7> [394.288042] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.288144] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [394.288239] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.288309] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.288316] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.288723] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.288956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.289051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.289143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.289228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.289310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.289421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.289504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.289591] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.289683] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.289814] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.290835] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.300747] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.300997] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.302071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.302189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.302267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.302349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.302421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.302501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.302573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.302644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.302715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.302800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.302881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.302979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.303050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.303129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.303198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.303277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.303348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.303419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.303489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.303568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.303667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.303751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.303835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.303909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.303988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.304061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.304133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.304208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.304286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.304390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.304467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.304550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.304629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.304714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.304811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.304888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.304961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.305032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.305103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.305212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.305288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.305361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.305441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.305512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.305595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.305668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.305745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.305816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.305888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.305989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.306062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.306134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.306214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.306285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.306362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.306434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.306504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.306575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.306647] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.306823] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.306827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87345, lrc_seqno=87345, guc_id=0, flags=0x73 in no process [-1] <7> [394.306829] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.306889] ------------[ cut here ]------------ <4> [394.306891] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.306893] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:42/3607 <4> [394.306969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.307027] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.307032] CPU: 4 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.307034] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.307036] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.307037] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.307042] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.307115] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.307117] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.307120] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.307122] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.307123] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.307125] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.307126] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.307127] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.307129] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.307131] CR2: 00007021e5a09b40 CR3: 00000001e2d1a004 CR4: 0000000000f72ef0 <4> [394.307133] PKRU: 55555554 <4> [394.307134] Call Trace: <4> [394.307135] <TASK> <4> [394.307139] ? lock_acquire+0x20/0x2f0 <4> [394.307145] ? lock_release+0xd0/0x2b0 <4> [394.307150] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.307156] process_one_work+0x239/0x760 <4> [394.307162] worker_thread+0x200/0x3f0 <4> [394.307165] ? __pfx_worker_thread+0x10/0x10 <4> [394.307167] kthread+0x10d/0x150 <4> [394.307170] ? __pfx_kthread+0x10/0x10 <4> [394.307174] ret_from_fork+0x3d4/0x480 <4> [394.307176] ? __pfx_kthread+0x10/0x10 <4> [394.307180] ret_from_fork_asm+0x1a/0x30 <4> [394.307187] </TASK> <4> [394.307188] irq event stamp: 422601 <4> [394.307190] hardirqs last enabled at (422607): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.307193] hardirqs last disabled at (422612): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.307195] softirqs last enabled at (421414): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.307198] softirqs last disabled at (421405): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.307200] ---[ end trace 0000000000000000 ]--- <7> [394.307823] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.307926] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.307925] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.307964] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.307964] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.308005] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [394.308528] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87359, lrc_seqno=87359, guc_id=0, flags=0x73 in no process [-1] <7> [394.308534] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.308591] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.308568] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [394.308644] ------------[ cut here ]------------ <4> [394.308646] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.308647] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:55/3620 <7> [394.308692] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [394.308769] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.308857] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.308864] CPU: 13 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.308868] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.308869] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.308871] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.308879] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.308989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.308992] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.308995] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.308996] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.308998] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.309000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.309002] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.309003] FS: 0000000000000000(0000) GS:ffff8888db318000(0000) knlGS:0000000000000000 <4> [394.309006] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.309008] CR2: 000000062b4e8040 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.309010] PKRU: 55555554 <4> [394.309012] Call Trace: <4> [394.309014] <TASK> <4> [394.309021] ? lock_acquire+0x20/0x2f0 <4> [394.309029] ? lock_release+0xd0/0x2b0 <4> [394.309038] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.309047] process_one_work+0x239/0x760 <4> [394.309057] worker_thread+0x200/0x3f0 <4> [394.309061] ? __pfx_worker_thread+0x10/0x10 <4> [394.309065] kthread+0x10d/0x150 <4> [394.309069] ? __pfx_kthread+0x10/0x10 <4> [394.309074] ret_from_fork+0x3d4/0x480 <4> [394.309077] ? __pfx_kthread+0x10/0x10 <4> [394.309082] ret_from_fork_asm+0x1a/0x30 <4> [394.309094] </TASK> <4> [394.309096] irq event stamp: 443177 <4> [394.309098] hardirqs last enabled at (443183): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.309102] hardirqs last disabled at (443188): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.309105] softirqs last enabled at (442080): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.309108] softirqs last disabled at (442073): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.309111] ---[ end trace 0000000000000000 ]--- <6> [394.309114] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.309225] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.309235] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.309310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.309575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.309707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.309847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.309977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.310106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.310233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.310362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.310489] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.310627] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.310793] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.312121] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.322897] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.323205] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.324362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.324480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.324596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.324713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.324836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.324955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.325073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.325191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.325308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.325426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.325544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.325662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.325783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.325902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.326019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.326137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.326255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.326373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.326491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.326612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.326734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.326862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.326985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.327105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.327225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.327344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.327464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.327587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.327711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.327837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.327961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.328084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.328212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.328340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.328467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.328593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.328717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.328842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.328964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.329084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.329208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.329330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.329452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.329571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.329697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.329821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.329943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.330063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.330185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.330305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.330424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.330547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.330668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.330792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.330914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.331037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.331158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.331278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.331403] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.331600] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.331606] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87359, lrc_seqno=87359, guc_id=0, flags=0x73 in no process [-1] <7> [394.331609] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.331708] ------------[ cut here ]------------ <4> [394.331710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.331712] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:55/3620 <4> [394.331828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.331915] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.331922] CPU: 13 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.331925] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.331927] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.331929] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.331936] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.332046] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.332048] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.332051] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.332052] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.332054] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.332056] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.332057] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.332059] FS: 0000000000000000(0000) GS:ffff8888db318000(0000) knlGS:0000000000000000 <4> [394.332061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.332063] CR2: 000000062b4e8040 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.332065] PKRU: 55555554 <4> [394.332066] Call Trace: <4> [394.332068] <TASK> <4> [394.332074] ? lock_acquire+0x20/0x2f0 <4> [394.332081] ? lock_release+0xd0/0x2b0 <4> [394.332089] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.332099] process_one_work+0x239/0x760 <4> [394.332108] worker_thread+0x200/0x3f0 <4> [394.332112] ? __pfx_worker_thread+0x10/0x10 <4> [394.332115] kthread+0x10d/0x150 <4> [394.332118] ? __pfx_kthread+0x10/0x10 <4> [394.332123] ret_from_fork+0x3d4/0x480 <4> [394.332126] ? __pfx_kthread+0x10/0x10 <4> [394.332130] ret_from_fork_asm+0x1a/0x30 <4> [394.332142] </TASK> <4> [394.332144] irq event stamp: 446485 <4> [394.332145] hardirqs last enabled at (446491): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.332148] hardirqs last disabled at (446496): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.332151] softirqs last enabled at (445736): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.332154] softirqs last disabled at (445731): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.332157] ---[ end trace 0000000000000000 ]--- <6> [394.332159] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.332269] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.332277] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.334035] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.334202] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.334359] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.334631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.334770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.334908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.335039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.335169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.335296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.335426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.335555] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.335694] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.335865] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.337205] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.348277] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.348584] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.350114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.350235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.350351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.350468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.350586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.350703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.350830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.350949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.351066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.351193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.351276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.351353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.351424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.351494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.351566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.351639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.351710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.351791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.351861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.351942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.352015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.352081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.352149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.352215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.352280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.352350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.352421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.352494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.352568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.352641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.352714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.352794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.352873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.352950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.353029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.353103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.353177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.353248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.353319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.353389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.353466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.353541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.353613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.353683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.353757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.353845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.353912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.353977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.354041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.354105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.354172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.354245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.354316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.354386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.354455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.354525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.354594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.354663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.354735] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.354874] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.354879] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87359, lrc_seqno=87359, guc_id=0, flags=0x73 in no process [-1] <7> [394.354882] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.354940] ------------[ cut here ]------------ <4> [394.354941] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.354943] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:7/205 <4> [394.355013] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.355080] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.355086] CPU: 7 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.355089] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.355090] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.355092] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.355098] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.355166] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.355167] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.355170] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.355171] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.355173] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.355174] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.355176] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.355177] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.355179] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.355180] CR2: 00007021e33f8000 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [394.355182] PKRU: 55555554 <4> [394.355183] Call Trace: <4> [394.355185] <TASK> <4> [394.355188] ? lock_acquire+0x20/0x2f0 <4> [394.355194] ? lock_release+0xd0/0x2b0 <4> [394.355200] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.355205] process_one_work+0x239/0x760 <4> [394.355212] worker_thread+0x200/0x3f0 <4> [394.355215] ? __pfx_worker_thread+0x10/0x10 <4> [394.355218] kthread+0x10d/0x150 <4> [394.355221] ? __pfx_kthread+0x10/0x10 <4> [394.355224] ret_from_fork+0x3d4/0x480 <4> [394.355226] ? __pfx_kthread+0x10/0x10 <4> [394.355230] ret_from_fork_asm+0x1a/0x30 <4> [394.355237] </TASK> <4> [394.355238] irq event stamp: 1332957 <4> [394.355240] hardirqs last enabled at (1332963): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.355243] hardirqs last disabled at (1332968): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.355245] softirqs last enabled at (1332044): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.355247] softirqs last disabled at (1332037): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.355250] ---[ end trace 0000000000000000 ]--- <5> [394.355831] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87373, lrc_seqno=87373, guc_id=0, flags=0x73 in no process [-1] <7> [394.355880] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.355895] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.355841] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.355996] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.356039] ------------[ cut here ]------------ <4> [394.356041] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.356061] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.356061] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.356080] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.356044] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:65/3630 <4> [394.356201] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.356323] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.356334] CPU: 13 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.356339] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.356341] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.356344] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.356355] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.356502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.356505] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.356509] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.356512] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.356514] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.356516] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.356518] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.356520] FS: 0000000000000000(0000) GS:ffff8888db318000(0000) knlGS:0000000000000000 <4> [394.356523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.356525] CR2: 000000062b4e8040 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.356527] PKRU: 55555554 <4> [394.356529] Call Trace: <4> [394.356531] <TASK> <4> [394.356539] ? lock_acquire+0x20/0x2f0 <4> [394.356552] ? lock_release+0xd0/0x2b0 <4> [394.356562] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.356574] process_one_work+0x239/0x760 <4> [394.356587] worker_thread+0x200/0x3f0 <4> [394.356592] ? __pfx_worker_thread+0x10/0x10 <4> [394.356596] kthread+0x10d/0x150 <4> [394.356600] ? __pfx_kthread+0x10/0x10 <4> [394.356607] ret_from_fork+0x3d4/0x480 <4> [394.356610] ? __pfx_kthread+0x10/0x10 <4> [394.356616] ret_from_fork_asm+0x1a/0x30 <4> [394.356631] </TASK> <4> [394.356633] irq event stamp: 171233 <4> [394.356635] hardirqs last enabled at (171239): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.356639] hardirqs last disabled at (171244): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.356643] softirqs last enabled at (170014): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.356647] softirqs last disabled at (170007): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.356651] ---[ end trace 0000000000000000 ]--- <6> [394.356654] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.356790] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.356798] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.356916] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.357071] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.357215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.357389] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.357443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.357541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.357638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.357727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.357825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.357910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.357995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.358078] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.358177] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.358295] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.359306] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.369774] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.370028] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.370967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.371050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.371129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.371207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.371285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.371361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.371437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.371513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.371588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.371663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.371740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.371835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.371910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.371984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.372058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.372133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.372208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.372283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.372358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.372442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.372526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.372605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.372683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.372759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.372851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.372927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.373002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.373079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.373159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.373236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.373315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.373392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.373475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.373558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.373642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.373723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.373813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.373891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.373968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.374047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.374126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.374203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.374278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.374351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.374430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.374505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.374578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.374654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.374731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.374812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.374887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.374963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.375038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.375111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.375186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.375261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.375333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.375408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.375485] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.375632] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.375636] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87373, lrc_seqno=87373, guc_id=0, flags=0x73 in no process [-1] <7> [394.375639] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.375701] ------------[ cut here ]------------ <4> [394.375702] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.375703] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:55/3620 <4> [394.375781] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.375842] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.375847] CPU: 10 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.375850] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.375851] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.375853] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.375859] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.375932] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.375934] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.375936] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.375938] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.375939] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.375941] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.375942] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.375943] FS: 0000000000000000(0000) GS:ffff8888db198000(0000) knlGS:0000000000000000 <4> [394.375945] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.375947] CR2: 000000062b4df000 CR3: 00000001e2d1a003 CR4: 0000000000f72ef0 <4> [394.375948] PKRU: 55555554 <4> [394.375950] Call Trace: <4> [394.375951] <TASK> <4> [394.375955] ? lock_acquire+0x20/0x2f0 <4> [394.375961] ? lock_release+0xd0/0x2b0 <4> [394.375966] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.375972] process_one_work+0x239/0x760 <4> [394.375978] worker_thread+0x200/0x3f0 <4> [394.375981] ? __pfx_worker_thread+0x10/0x10 <4> [394.375984] kthread+0x10d/0x150 <4> [394.375987] ? __pfx_kthread+0x10/0x10 <4> [394.375990] ret_from_fork+0x3d4/0x480 <4> [394.375993] ? __pfx_kthread+0x10/0x10 <4> [394.375996] ret_from_fork_asm+0x1a/0x30 <4> [394.376004] </TASK> <4> [394.376005] irq event stamp: 450379 <4> [394.376006] hardirqs last enabled at (450385): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.376009] hardirqs last disabled at (450390): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.376012] softirqs last enabled at (449210): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.376014] softirqs last disabled at (449201): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.376017] ---[ end trace 0000000000000000 ]--- <6> [394.376817] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.376996] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.377006] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.377061] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.377159] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.377260] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.377476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.377562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.377650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.377731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.377828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.377908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.377987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.378063] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.378153] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.378265] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.379274] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.389996] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.390245] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.391251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.391328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.391401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.391475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.391549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.391622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.391693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.391765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.391852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.391924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.391994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.392063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.392132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.392202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.392272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.392342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.392412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.392480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.392549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.392626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.392701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.392774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.392862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.392934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.393004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.393073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.393142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.393213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.393285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.393356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.393427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.393499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.393574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.393651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.393727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.393808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.393883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.393951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.394020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.394088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.394160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.394229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.394300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.394368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.394441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.394510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.394579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.394650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.394722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.394796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.394866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.394938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.395007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.395076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.395144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.395213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.395279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.395345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.395417] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.395549] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.395553] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87373, lrc_seqno=87373, guc_id=0, flags=0x73 in no process [-1] <7> [394.395555] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.395614] ------------[ cut here ]------------ <4> [394.395615] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.395616] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.395685] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.395746] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.395752] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.395755] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.395757] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.395758] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.395764] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.395844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.395846] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.395848] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.395850] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.395852] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.395853] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.395854] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.395856] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.395858] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.395860] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.395861] PKRU: 55555554 <4> [394.395862] Call Trace: <4> [394.395864] <TASK> <4> [394.395868] ? lock_acquire+0x20/0x2f0 <4> [394.395874] ? lock_release+0xd0/0x2b0 <4> [394.395879] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.395885] process_one_work+0x239/0x760 <4> [394.395891] worker_thread+0x200/0x3f0 <4> [394.395894] ? __pfx_worker_thread+0x10/0x10 <4> [394.395896] kthread+0x10d/0x150 <4> [394.395899] ? __pfx_kthread+0x10/0x10 <4> [394.395902] ret_from_fork+0x3d4/0x480 <4> [394.395904] ? __pfx_kthread+0x10/0x10 <4> [394.395908] ret_from_fork_asm+0x1a/0x30 <4> [394.395915] </TASK> <4> [394.395916] irq event stamp: 453705 <4> [394.395917] hardirqs last enabled at (453711): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.395920] hardirqs last disabled at (453716): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.395922] softirqs last enabled at (452724): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.395925] softirqs last disabled at (452719): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.395927] ---[ end trace 0000000000000000 ]--- <7> [394.396619] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.396621] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.396715] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.396772] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.396772] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.396772] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.396812] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [394.397352] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87387, lrc_seqno=87387, guc_id=0, flags=0x73 in no process [-1] <7> [394.397355] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.397421] ------------[ cut here ]------------ <4> [394.397422] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.397423] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.397492] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.397550] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.397555] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.397558] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.397559] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.397560] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.397565] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.397633] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.397635] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.397637] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.397638] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.397639] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.397640] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.397641] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.397643] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.397644] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.397645] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.397647] PKRU: 55555554 <4> [394.397648] Call Trace: <4> [394.397649] <TASK> <4> [394.397652] ? lock_acquire+0x20/0x2f0 <4> [394.397657] ? lock_release+0xd0/0x2b0 <4> [394.397662] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.397668] process_one_work+0x239/0x760 <4> [394.397674] worker_thread+0x200/0x3f0 <4> [394.397676] ? __pfx_worker_thread+0x10/0x10 <4> [394.397679] kthread+0x10d/0x150 <4> [394.397681] ? __pfx_kthread+0x10/0x10 <4> [394.397685] ret_from_fork+0x3d4/0x480 <4> [394.397686] ? __pfx_kthread+0x10/0x10 <4> [394.397689] ret_from_fork_asm+0x1a/0x30 <4> [394.397697] </TASK> <4> [394.397698] irq event stamp: 455079 <4> [394.397699] hardirqs last enabled at (455085): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.397701] hardirqs last disabled at (455090): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.397703] softirqs last enabled at (454218): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.397705] softirqs last disabled at (454216): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.397708] ---[ end trace 0000000000000000 ]--- <6> [394.397709] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.397783] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.397798] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.397813] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.397916] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.398206] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.398426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.398520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.398648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.398737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.398844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.398930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.399026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.399106] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.399199] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.399311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.400443] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.410795] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.411070] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.412255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.412339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.412413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.412494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.412569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.412641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.412713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.412790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.412887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.412959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.413031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.413111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.413183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.413260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.413331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.413403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.413472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.413543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.413612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.413720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.413804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.413883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.413964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.414036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.414116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.414188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.414259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.414333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.414406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.414509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.414585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.414661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.414746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.414845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.414925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.415001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.415078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.415151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.415249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.415328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.415404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.415484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.415555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.415634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.415710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.415782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.415872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.415943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.416029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.416131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.416203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.416286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.416358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.416429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.416507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.416579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.416649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.416720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.416798] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.416972] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.416976] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87387, lrc_seqno=87387, guc_id=0, flags=0x73 in no process [-1] <7> [394.416979] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.417037] ------------[ cut here ]------------ <4> [394.417038] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.417040] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:65/3630 <4> [394.417118] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.417176] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.417182] CPU: 4 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.417184] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.417185] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.417187] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.417192] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.417266] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.417268] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.417271] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.417273] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.417274] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.417276] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.417277] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.417279] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.417280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.417282] CR2: 00007021e5a09b40 CR3: 000000018ad33005 CR4: 0000000000f72ef0 <4> [394.417284] PKRU: 55555554 <4> [394.417285] Call Trace: <4> [394.417286] <TASK> <4> [394.417291] ? lock_acquire+0x20/0x2f0 <4> [394.417296] ? lock_release+0xd0/0x2b0 <4> [394.417302] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.417308] process_one_work+0x239/0x760 <4> [394.417314] worker_thread+0x200/0x3f0 <4> [394.417317] ? __pfx_worker_thread+0x10/0x10 <4> [394.417319] kthread+0x10d/0x150 <4> [394.417322] ? __pfx_kthread+0x10/0x10 <4> [394.417326] ret_from_fork+0x3d4/0x480 <4> [394.417328] ? __pfx_kthread+0x10/0x10 <4> [394.417331] ret_from_fork_asm+0x1a/0x30 <4> [394.417339] </TASK> <4> [394.417340] irq event stamp: 175545 <4> [394.417341] hardirqs last enabled at (175551): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.417344] hardirqs last disabled at (175556): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.417347] softirqs last enabled at (174624): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.417349] softirqs last disabled at (174617): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.417352] ---[ end trace 0000000000000000 ]--- <6> [394.417354] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.417424] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.417430] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.417842] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.418073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.418160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.418255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.418338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.418419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.418499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.418579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.418657] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.418781] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.418916] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.419936] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.430664] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.430908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.432038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.432110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.432179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.432247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.432313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.432380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.432446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.432511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.432577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.432640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.432704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.432767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.432850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.432921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.432991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.433062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.433132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.433201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.433303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.433384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.433469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.433545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.433629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.433703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.433776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.433862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.433935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.434011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.434087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.434195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.434274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.434356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.434434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.434521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.434600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.434675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.434749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.434829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.434929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.435003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.435084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.435156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.435233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.435304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.435377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.435448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.435518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.435588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.435676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.435763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.435853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.435927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.436007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.436078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.436149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.436221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.436290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.436390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.436470] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.436621] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.436625] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87387, lrc_seqno=87387, guc_id=0, flags=0x73 in no process [-1] <7> [394.436627] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.436685] ------------[ cut here ]------------ <4> [394.436687] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.436689] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:65/3630 <4> [394.436757] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.436830] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.436835] CPU: 4 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.436838] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.436840] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.436841] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.436846] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.436909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.436911] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.436913] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.436915] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.436916] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.436917] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.436919] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.436920] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.436922] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.436923] CR2: 00007021e5a09b40 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.436925] PKRU: 55555554 <4> [394.436926] Call Trace: <4> [394.436927] <TASK> <4> [394.436931] ? lock_acquire+0x20/0x2f0 <4> [394.436936] ? lock_release+0xd0/0x2b0 <4> [394.436941] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.436946] process_one_work+0x239/0x760 <4> [394.436951] worker_thread+0x200/0x3f0 <4> [394.436953] ? __pfx_worker_thread+0x10/0x10 <4> [394.436955] kthread+0x10d/0x150 <4> [394.436958] ? __pfx_kthread+0x10/0x10 <4> [394.436961] ret_from_fork+0x3d4/0x480 <4> [394.436962] ? __pfx_kthread+0x10/0x10 <4> [394.436965] ret_from_fork_asm+0x1a/0x30 <4> [394.436972] </TASK> <4> [394.436973] irq event stamp: 178861 <4> [394.436974] hardirqs last enabled at (178867): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.436976] hardirqs last disabled at (178872): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.436978] softirqs last enabled at (177698): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.436980] softirqs last disabled at (177691): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.436982] ---[ end trace 0000000000000000 ]--- <7> [394.438058] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.438201] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.438164] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [394.438268] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87401, lrc_seqno=87401, guc_id=0, flags=0x73 in no process [-1] <7> [394.438271] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.438299] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.438324] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.438331] ------------[ cut here ]------------ <4> [394.438332] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.438333] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:65/3630 <4> [394.438403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.438462] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.438466] CPU: 4 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.438469] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.438470] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.438471] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.438476] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.438547] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.438549] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.438551] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.438552] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.438553] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.438554] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.438555] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.438557] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.438558] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.438559] CR2: 00007021e5a09b40 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.438561] PKRU: 55555554 <4> [394.438562] Call Trace: <4> [394.438563] <TASK> <4> [394.438566] ? lock_acquire+0x20/0x2f0 <4> [394.438571] ? lock_release+0xd0/0x2b0 <4> [394.438576] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.438582] process_one_work+0x239/0x760 <4> [394.438587] worker_thread+0x200/0x3f0 <4> [394.438590] ? __pfx_worker_thread+0x10/0x10 <4> [394.438592] kthread+0x10d/0x150 <4> [394.438595] ? __pfx_kthread+0x10/0x10 <4> [394.438598] ret_from_fork+0x3d4/0x480 <4> [394.438600] ? __pfx_kthread+0x10/0x10 <4> [394.438603] ret_from_fork_asm+0x1a/0x30 <4> [394.438610] </TASK> <4> [394.438611] irq event stamp: 180151 <4> [394.438612] hardirqs last enabled at (180157): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.438614] hardirqs last disabled at (180162): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.438616] softirqs last enabled at (177698): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.438618] softirqs last disabled at (177691): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.438620] ---[ end trace 0000000000000000 ]--- <6> [394.438622] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.438717] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.438727] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.438910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.438977] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.439074] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.439131] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.439146] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 512; Own pages: 0. <7> [394.439170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.439290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.439411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.439519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.439606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.439689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.439771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.439867] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.439962] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.440075] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.441085] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.451819] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.452079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.453074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.453155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.453230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.453305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.453377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.453449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.453521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.453592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.453663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.453734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.453813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.453883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.453953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.454023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.454093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.454162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.454231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.454301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.454370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.454450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.454529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.454605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.454679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.454752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.454831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.454903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.454973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.455047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.455122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.455193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.455266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.455338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.455416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.455492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.455568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.455641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.455713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.455785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.455866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.455935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.456011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.456085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.456155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.456225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.456300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.456371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.456443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.456514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.456584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.456652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.456722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.456794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.456878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.456948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.457017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.457087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.457155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.457225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.457297] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.457425] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.457430] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87401, lrc_seqno=87401, guc_id=0, flags=0x73 in no process [-1] <7> [394.457433] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.457491] ------------[ cut here ]------------ <4> [394.457492] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.457494] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.457565] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.457625] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.457630] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.457633] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.457634] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.457635] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.457640] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.457709] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.457711] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.457713] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.457714] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.457715] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.457716] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.457717] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.457719] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.457720] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.457721] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.457723] PKRU: 55555554 <4> [394.457724] Call Trace: <4> [394.457725] <TASK> <4> [394.457729] ? lock_acquire+0x20/0x2f0 <4> [394.457734] ? lock_release+0xd0/0x2b0 <4> [394.457739] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.457745] process_one_work+0x239/0x760 <4> [394.457751] worker_thread+0x200/0x3f0 <4> [394.457753] ? __pfx_worker_thread+0x10/0x10 <4> [394.457755] kthread+0x10d/0x150 <4> [394.457758] ? __pfx_kthread+0x10/0x10 <4> [394.457761] ret_from_fork+0x3d4/0x480 <4> [394.457763] ? __pfx_kthread+0x10/0x10 <4> [394.457766] ret_from_fork_asm+0x1a/0x30 <4> [394.457773] </TASK> <4> [394.457774] irq event stamp: 458591 <4> [394.457775] hardirqs last enabled at (458597): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.457778] hardirqs last disabled at (458602): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.457780] softirqs last enabled at (457536): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.457782] softirqs last disabled at (457529): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.457784] ---[ end trace 0000000000000000 ]--- <6> [394.457786] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.457867] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.457873] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.459121] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.459224] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.459326] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.459556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.459654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.459750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.459848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.459936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.460020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.460105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.460186] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.460286] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.460404] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.461416] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.472147] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.472401] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.473393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.473476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.473555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.473634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.473711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.473787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.473873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.473950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.474024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.474098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.474172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.474246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.474320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.474395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.474470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.474545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.474618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.474693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.474768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.474859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.474941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.475020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.475099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.475174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.475248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.475324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.475398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.475476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.475554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.475631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.475709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.475789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.475882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.475966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.476050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.476130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.476209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.476287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.476364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.476439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.476518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.476594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.476669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.476744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.476825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.476901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.476975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.477048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.477123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.477196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.477269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.477345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.477419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.477494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.477571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.477649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.477723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.477797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.477886] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.478052] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.478056] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87401, lrc_seqno=87401, guc_id=0, flags=0x73 in no process [-1] <7> [394.478058] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.478121] ------------[ cut here ]------------ <4> [394.478122] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.478124] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:7/205 <4> [394.478199] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.478259] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.478264] CPU: 7 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.478267] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.478268] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.478269] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.478275] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.478347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.478349] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.478351] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.478352] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.478353] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.478354] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.478356] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.478357] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.478358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.478360] CR2: 00007021e33f8000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [394.478361] PKRU: 55555554 <4> [394.478362] Call Trace: <4> [394.478363] <TASK> <4> [394.478367] ? lock_acquire+0x20/0x2f0 <4> [394.478373] ? lock_release+0xd0/0x2b0 <4> [394.478378] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.478384] process_one_work+0x239/0x760 <4> [394.478390] worker_thread+0x200/0x3f0 <4> [394.478392] ? __pfx_worker_thread+0x10/0x10 <4> [394.478395] kthread+0x10d/0x150 <4> [394.478397] ? __pfx_kthread+0x10/0x10 <4> [394.478401] ret_from_fork+0x3d4/0x480 <4> [394.478403] ? __pfx_kthread+0x10/0x10 <4> [394.478406] ret_from_fork_asm+0x1a/0x30 <4> [394.478413] </TASK> <4> [394.478414] irq event stamp: 1337633 <4> [394.478415] hardirqs last enabled at (1337639): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.478418] hardirqs last disabled at (1337644): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.478420] softirqs last enabled at (1336522): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.478422] softirqs last disabled at (1336515): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.478424] ---[ end trace 0000000000000000 ]--- <7> [394.479233] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.479237] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.479286] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [394.479794] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87415, lrc_seqno=87415, guc_id=0, flags=0x73 in no process [-1] <7> [394.479793] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.479797] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.479839] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.479882] ------------[ cut here ]------------ <4> [394.479883] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.479884] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:7/205 <4> [394.479956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.480016] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.480021] CPU: 7 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.480023] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.480024] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.480025] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.480031] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.480099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.480100] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <7> [394.480098] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.480103] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.480104] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.480105] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.480107] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.480108] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.480109] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.480111] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.480112] CR2: 00007021e33f8000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [394.480113] PKRU: 55555554 <4> [394.480114] Call Trace: <4> [394.480115] <TASK> <4> [394.480119] ? lock_acquire+0x20/0x2f0 <4> [394.480124] ? lock_release+0xd0/0x2b0 <4> [394.480130] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <7> [394.480130] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.480135] process_one_work+0x239/0x760 <4> [394.480141] worker_thread+0x200/0x3f0 <4> [394.480144] ? __pfx_worker_thread+0x10/0x10 <4> [394.480146] kthread+0x10d/0x150 <4> [394.480149] ? __pfx_kthread+0x10/0x10 <4> [394.480152] ret_from_fork+0x3d4/0x480 <4> [394.480154] ? __pfx_kthread+0x10/0x10 <4> [394.480157] ret_from_fork_asm+0x1a/0x30 <4> [394.480165] </TASK> <4> [394.480166] irq event stamp: 1338913 <4> [394.480167] hardirqs last enabled at (1338919): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.480169] hardirqs last disabled at (1338924): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.480171] softirqs last enabled at (1336522): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.480174] softirqs last disabled at (1336515): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.480176] ---[ end trace 0000000000000000 ]--- <6> [394.480178] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.480247] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.480258] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.480468] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.480571] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.480675] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.480895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.480985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.481074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.481158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.481239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.481318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.481399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.481477] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.481575] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.481687] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.482714] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.492827] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.493106] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.494120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.494199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.494272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.494346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.494418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.494490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.494561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.494632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.494702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.494772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.494850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.494920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.494990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.495061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.495132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.495201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.495273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.495343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.495412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.495493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.495570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.495645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.495721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.495793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.495877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.495949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.496019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.496094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.496168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.496240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.496312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.496385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.496463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.496541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.496619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.496694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.496770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.496854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.496929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.497000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.497074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.497146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.497218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.497288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.497362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.497431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.497501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.497570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.497642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.497710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.497779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.497861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.497933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.498005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.498075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.498147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.498217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.498286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.498359] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.498479] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.498498] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87415, lrc_seqno=87415, guc_id=0, flags=0x73 in no process [-1] <7> [394.498505] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.498703] ------------[ cut here ]------------ <4> [394.498705] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.498707] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:45/3610 <4> [394.498832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.498933] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.498941] CPU: 13 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.498945] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.498947] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.498949] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.498959] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.499069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.499072] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.499075] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.499077] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.499079] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.499081] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.499083] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.499084] FS: 0000000000000000(0000) GS:ffff8888db318000(0000) knlGS:0000000000000000 <4> [394.499087] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.499088] CR2: 000000062b4e8040 CR3: 00000001e2d1a004 CR4: 0000000000f72ef0 <4> [394.499090] PKRU: 55555554 <4> [394.499092] Call Trace: <4> [394.499093] <TASK> <4> [394.499100] ? lock_acquire+0x20/0x2f0 <4> [394.499110] ? lock_release+0xd0/0x2b0 <4> [394.499118] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.499127] process_one_work+0x239/0x760 <4> [394.499138] worker_thread+0x200/0x3f0 <4> [394.499142] ? __pfx_worker_thread+0x10/0x10 <4> [394.499145] kthread+0x10d/0x150 <4> [394.499150] ? __pfx_kthread+0x10/0x10 <4> [394.499155] ret_from_fork+0x3d4/0x480 <4> [394.499158] ? __pfx_kthread+0x10/0x10 <4> [394.499163] ret_from_fork_asm+0x1a/0x30 <4> [394.499175] </TASK> <4> [394.499177] irq event stamp: 580695 <4> [394.499178] hardirqs last enabled at (580701): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.499182] hardirqs last disabled at (580706): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.499186] softirqs last enabled at (579804): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.499189] softirqs last disabled at (579802): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.499193] ---[ end trace 0000000000000000 ]--- <6> [394.499197] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.499309] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.499322] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.499470] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.499572] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.499676] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.499942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.500073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.500207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.500336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.500465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.500592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.500721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.500855] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.500994] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.501156] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.502510] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.512836] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.513144] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.514321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.514439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.514554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.514672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.514790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.514913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.515032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.515149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.515266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.515383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.515500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.515618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.515735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.515856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.515974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.516092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.516209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.516326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.516442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.516564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.516685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.516806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.516932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.517053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.517174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.517295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.517415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.517540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.517665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.517788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.517918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.518042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.518171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.518299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.518426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.518551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.518676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.518797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.518934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.519026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.519112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.519219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.519309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.519393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.519473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.519558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.519636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.519710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.519783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.519865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.519961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.520045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.520124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.520197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.520273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.520346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.520416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.520486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.520559] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.520723] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.520727] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87415, lrc_seqno=87415, guc_id=0, flags=0x73 in no process [-1] <7> [394.520729] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.520788] ------------[ cut here ]------------ <4> [394.520789] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.520790] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:45/3610 <4> [394.520880] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.520940] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.520944] CPU: 4 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.520947] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.520948] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.520950] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.520955] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.521029] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.521032] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.521034] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.521036] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.521037] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.521039] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.521040] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.521042] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.521043] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.521045] CR2: 00007021e5a09b40 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.521047] PKRU: 55555554 <4> [394.521048] Call Trace: <4> [394.521050] <TASK> <4> [394.521054] ? lock_acquire+0x20/0x2f0 <4> [394.521060] ? lock_release+0xd0/0x2b0 <4> [394.521065] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.521071] process_one_work+0x239/0x760 <4> [394.521078] worker_thread+0x200/0x3f0 <4> [394.521080] ? __pfx_worker_thread+0x10/0x10 <4> [394.521083] kthread+0x10d/0x150 <4> [394.521086] ? __pfx_kthread+0x10/0x10 <4> [394.521089] ret_from_fork+0x3d4/0x480 <4> [394.521092] ? __pfx_kthread+0x10/0x10 <4> [394.521095] ret_from_fork_asm+0x1a/0x30 <4> [394.521102] </TASK> <4> [394.521104] irq event stamp: 584057 <4> [394.521105] hardirqs last enabled at (584063): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.521108] hardirqs last disabled at (584068): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.521110] softirqs last enabled at (583076): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.521113] softirqs last disabled at (583069): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.521115] ---[ end trace 0000000000000000 ]--- <5> [394.522473] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87429, lrc_seqno=87429, guc_id=0, flags=0x73 in no process [-1] <7> [394.522436] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.522478] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.522508] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.522522] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.522541] ------------[ cut here ]------------ <4> [394.522542] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.522565] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.522543] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:45/3610 <7> [394.522556] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.522614] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.522620] Modules linked in: <7> [394.522616] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.522621] snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart <7> [394.522640] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.522645] asus_nb_wmi spi_nor coretemp <7> [394.522643] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.522647] asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.522695] CPU: 0 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.522698] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.522699] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.522700] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.522706] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.522777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.522779] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.522781] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.522783] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.522784] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.522785] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.522787] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.522788] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.522790] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.522791] CR2: 000000062b8b0000 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [394.522793] PKRU: 55555554 <4> [394.522794] Call Trace: <4> [394.522796] <TASK> <4> [394.522799] ? lock_acquire+0x20/0x2f0 <4> [394.522806] ? lock_release+0xd0/0x2b0 <4> [394.522811] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.522817] process_one_work+0x239/0x760 <4> [394.522823] worker_thread+0x200/0x3f0 <4> [394.522826] ? __pfx_worker_thread+0x10/0x10 <4> [394.522829] kthread+0x10d/0x150 <4> [394.522840] ? __pfx_kthread+0x10/0x10 <4> [394.522846] ret_from_fork+0x3d4/0x480 <4> [394.522849] ? __pfx_kthread+0x10/0x10 <4> [394.522854] ret_from_fork_asm+0x1a/0x30 <4> [394.522867] </TASK> <4> [394.522869] irq event stamp: 585351 <4> [394.522871] hardirqs last enabled at (585357): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.522875] hardirqs last disabled at (585362): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.522879] softirqs last enabled at (585316): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.522883] softirqs last disabled at (585309): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.522886] ---[ end trace 0000000000000000 ]--- <6> [394.522889] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.522981] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.522988] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.523394] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.523614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.523707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.523799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.523899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.523986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.524067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.524148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.524224] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.524316] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.524428] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.525437] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.536159] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.536408] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.537395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.537472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.537542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.537616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.537688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.537761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.537833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.537920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.537991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.538061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.538131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.538201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.538271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.538341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.538409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.538476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.538545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.538614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.538682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.538761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.538841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.538915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.538987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.539058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.539129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.539199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.539268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.539340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.539413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.539484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.539556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.539628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.539706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.539783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.539864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.539938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.540012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.540082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.540153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.540222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.540295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.540365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.540435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.540505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.540578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.540648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.540718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.540788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.540863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.540932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.541002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.541074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.541144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.541215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.541285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.541356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.541425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.541493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.541565] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.541713] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.541717] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87429, lrc_seqno=87429, guc_id=0, flags=0x73 in no process [-1] <7> [394.541719] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.541777] ------------[ cut here ]------------ <4> [394.541778] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.541779] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.541853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.541926] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.541932] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.541936] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.541937] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.541939] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.541944] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.542011] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.542013] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.542015] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.542017] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.542019] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.542020] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.542021] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.542023] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.542024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.542026] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.542027] PKRU: 55555554 <4> [394.542029] Call Trace: <4> [394.542030] <TASK> <4> [394.542034] ? lock_acquire+0x20/0x2f0 <4> [394.542040] ? lock_release+0xd0/0x2b0 <4> [394.542045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.542051] process_one_work+0x239/0x760 <4> [394.542057] worker_thread+0x200/0x3f0 <4> [394.542060] ? __pfx_worker_thread+0x10/0x10 <4> [394.542063] kthread+0x10d/0x150 <4> [394.542066] ? __pfx_kthread+0x10/0x10 <4> [394.542069] ret_from_fork+0x3d4/0x480 <4> [394.542071] ? __pfx_kthread+0x10/0x10 <4> [394.542074] ret_from_fork_asm+0x1a/0x30 <4> [394.542081] </TASK> <4> [394.542082] irq event stamp: 462665 <4> [394.542083] hardirqs last enabled at (462671): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.542086] hardirqs last disabled at (462676): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.542088] softirqs last enabled at (461916): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.542091] softirqs last disabled at (461911): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.542093] ---[ end trace 0000000000000000 ]--- <6> [394.542095] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.542162] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.542168] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.542576] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.542788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.542878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.542964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.543045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.543124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.543203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.543281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.543357] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.543448] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.543559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.544578] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.554852] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.555100] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.556110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.556188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.556262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.556335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.556408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.556479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.556551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.556622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.556693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.556761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.556830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.556911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.556982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.557051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.557120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.557190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.557261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.557330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.557399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.557476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.557552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.557629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.557704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.557776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.557850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.557922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.557993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.558066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.558141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.558213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.558286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.558359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.558437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.558515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.558591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.558665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.558737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.558809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.558888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.558957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.559030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.559101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.559171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.559241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.559314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.559383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.559454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.559523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.559592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.559661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.559729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.559800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.559876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.559947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.560016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.560086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.560152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.560220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.560291] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.560435] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.560439] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87429, lrc_seqno=87429, guc_id=0, flags=0x73 in no process [-1] <7> [394.560441] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.560499] ------------[ cut here ]------------ <4> [394.560500] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.560501] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.560571] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.560637] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.560642] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.560645] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.560646] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.560648] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.560653] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.560721] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.560723] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.560725] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.560727] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.560728] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.560729] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.560731] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.560732] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.560734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.560735] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.560737] PKRU: 55555554 <4> [394.560738] Call Trace: <4> [394.560739] <TASK> <4> [394.560743] ? lock_acquire+0x20/0x2f0 <4> [394.560749] ? lock_release+0xd0/0x2b0 <4> [394.560754] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.560760] process_one_work+0x239/0x760 <4> [394.560766] worker_thread+0x200/0x3f0 <4> [394.560769] ? __pfx_worker_thread+0x10/0x10 <4> [394.560771] kthread+0x10d/0x150 <4> [394.560774] ? __pfx_kthread+0x10/0x10 <4> [394.560778] ret_from_fork+0x3d4/0x480 <4> [394.560780] ? __pfx_kthread+0x10/0x10 <4> [394.560783] ret_from_fork_asm+0x1a/0x30 <4> [394.560790] </TASK> <4> [394.560792] irq event stamp: 465983 <4> [394.560793] hardirqs last enabled at (465989): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.560796] hardirqs last disabled at (465994): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.560798] softirqs last enabled at (465024): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.560800] softirqs last disabled at (465017): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.560803] ---[ end trace 0000000000000000 ]--- <7> [394.561252] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.561279] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.561329] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.561329] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.561358] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.561370] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.561507] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [394.561789] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87443, lrc_seqno=87443, guc_id=0, flags=0x73 in no process [-1] <7> [394.561792] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.561868] ------------[ cut here ]------------ <4> [394.561870] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.561872] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.561949] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.562011] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.562016] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.562019] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.562020] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.562021] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.562026] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.562096] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.562098] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.562100] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.562101] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.562102] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.562103] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.562104] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.562106] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.562107] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.562108] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.562110] PKRU: 55555554 <4> [394.562111] Call Trace: <4> [394.562112] <TASK> <4> [394.562116] ? lock_acquire+0x20/0x2f0 <4> [394.562121] ? lock_release+0xd0/0x2b0 <4> [394.562126] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.562132] process_one_work+0x239/0x760 <4> [394.562138] worker_thread+0x200/0x3f0 <4> [394.562140] ? __pfx_worker_thread+0x10/0x10 <4> [394.562143] kthread+0x10d/0x150 <4> [394.562145] ? __pfx_kthread+0x10/0x10 <4> [394.562149] ret_from_fork+0x3d4/0x480 <4> [394.562150] ? __pfx_kthread+0x10/0x10 <4> [394.562154] ret_from_fork_asm+0x1a/0x30 <4> [394.562161] </TASK> <4> [394.562162] irq event stamp: 466919 <4> [394.562163] hardirqs last enabled at (466925): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.562165] hardirqs last disabled at (466930): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.562167] softirqs last enabled at (465024): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.562170] softirqs last disabled at (465017): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.562172] ---[ end trace 0000000000000000 ]--- <6> [394.562173] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.562243] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.562251] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.562706] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.562809] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.562921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.563155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.563242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.563331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.563415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.563498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.563579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.563664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.563743] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.563858] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.563978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.564989] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.574863] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.575112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.576124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.576204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.576277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.576351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.576422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.576493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.576564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.576634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.576704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.576774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.576844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.576931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.577002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.577071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.577140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.577210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.577280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.577349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.577418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.577497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.577575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.577649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.577724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.577797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.577874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.577946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.578019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.578095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.578170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.578243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.578345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.578431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.578510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.578589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.578667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.578742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.578816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.578907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.578980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.579051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.579125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.579196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.579267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.579336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.579410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.579480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.579550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.579619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.579689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.579758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.579827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.579912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.579983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.580055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.580125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.580196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.580266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.580334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.580423] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.580560] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.580563] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87443, lrc_seqno=87443, guc_id=0, flags=0x73 in no process [-1] <7> [394.580565] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.580624] ------------[ cut here ]------------ <4> [394.580625] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.580626] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.580696] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.580754] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.580759] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.580761] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.580762] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.580764] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.580769] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.580838] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.580840] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.580842] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.580844] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.580845] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.580847] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.580848] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.580850] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.580851] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.580853] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.580859] PKRU: 55555554 <4> [394.580861] Call Trace: <4> [394.580862] <TASK> <4> [394.580866] ? lock_acquire+0x20/0x2f0 <4> [394.580872] ? lock_release+0xd0/0x2b0 <4> [394.580877] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.580883] process_one_work+0x239/0x760 <4> [394.580889] worker_thread+0x200/0x3f0 <4> [394.580892] ? __pfx_worker_thread+0x10/0x10 <4> [394.580894] kthread+0x10d/0x150 <4> [394.580897] ? __pfx_kthread+0x10/0x10 <4> [394.580901] ret_from_fork+0x3d4/0x480 <4> [394.580903] ? __pfx_kthread+0x10/0x10 <4> [394.580907] ret_from_fork_asm+0x1a/0x30 <4> [394.580914] </TASK> <4> [394.580915] irq event stamp: 470257 <4> [394.580917] hardirqs last enabled at (470263): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.580920] hardirqs last disabled at (470268): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.580922] softirqs last enabled at (469288): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.580924] softirqs last disabled at (469281): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.580927] ---[ end trace 0000000000000000 ]--- <6> [394.581847] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.581938] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.581949] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.582001] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.582101] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.582202] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.582415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.582501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.582588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.582671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.582752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.582832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.582925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.583005] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.583098] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.583207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.584214] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.594869] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.595139] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.596153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.596230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.596302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.596375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.596448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.596519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.596591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.596663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.596736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.596809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.596892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.596964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.597035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.597104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.597176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.597247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.597317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.597384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.597454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.597533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.597611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.597685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.597759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.597831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.597915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.597988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.598058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.598131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.598206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.598278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.598352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.598426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.598503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.598580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.598657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.598734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.598809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.598884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.598956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.599026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.599100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.599172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.599243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.599314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.599389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.599461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.599533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.599603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.599674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.599743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.599812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.599887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.599958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.600026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.600095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.600168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.600239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.600309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.600383] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.600530] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.600533] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87443, lrc_seqno=87443, guc_id=0, flags=0x73 in no process [-1] <7> [394.600535] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.600594] ------------[ cut here ]------------ <4> [394.600595] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.600596] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:55/3620 <4> [394.600667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.600725] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.600730] CPU: 11 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.600733] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.600734] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.600735] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.600740] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.600809] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.600810] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.600812] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.600813] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.600815] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.600816] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.600817] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.600818] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.600819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.600821] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.600822] PKRU: 55555554 <4> [394.600823] Call Trace: <4> [394.600824] <TASK> <4> [394.600828] ? lock_acquire+0x20/0x2f0 <4> [394.600833] ? lock_release+0xd0/0x2b0 <4> [394.600838] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.600844] process_one_work+0x239/0x760 <4> [394.600850] worker_thread+0x200/0x3f0 <4> [394.600852] ? __pfx_worker_thread+0x10/0x10 <4> [394.600854] kthread+0x10d/0x150 <4> [394.600857] ? __pfx_kthread+0x10/0x10 <4> [394.600860] ret_from_fork+0x3d4/0x480 <4> [394.600870] ? __pfx_kthread+0x10/0x10 <4> [394.600873] ret_from_fork_asm+0x1a/0x30 <4> [394.600880] </TASK> <4> [394.600882] irq event stamp: 473633 <4> [394.600883] hardirqs last enabled at (473639): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.600888] hardirqs last disabled at (473644): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.600890] softirqs last enabled at (473612): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.600910] softirqs last disabled at (473595): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.600912] ---[ end trace 0000000000000000 ]--- <7> [394.601940] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [394.602085] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87457, lrc_seqno=87457, guc_id=0, flags=0x73 in no process [-1] <7> [394.602119] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.602090] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.602079] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [394.602156] ------------[ cut here ]------------ <4> [394.602157] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.602178] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.602158] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:42/3607 <7> [394.602221] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.602236] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common <7> [394.602250] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.602254] intel_uncore_frequency <7> [394.602250] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.602256] intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei <7> [394.602284] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.602287] spi_intel <4> [394.602289] intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 <7> [394.602290] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.602295] intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.602306] CPU: 2 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.602309] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.602310] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.602311] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.602316] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.602417] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.602420] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.602423] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.602426] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.602428] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.602430] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.602432] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.602434] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [394.602436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.602438] CR2: 00007d9f251a804c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [394.602441] PKRU: 55555554 <4> [394.602443] Call Trace: <4> [394.602444] <TASK> <4> [394.602451] ? lock_acquire+0x20/0x2f0 <4> [394.602460] ? lock_release+0xd0/0x2b0 <4> [394.602469] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.602479] process_one_work+0x239/0x760 <4> [394.602489] worker_thread+0x200/0x3f0 <4> [394.602494] ? __pfx_worker_thread+0x10/0x10 <4> [394.602497] kthread+0x10d/0x150 <4> [394.602501] ? __pfx_kthread+0x10/0x10 <4> [394.602507] ret_from_fork+0x3d4/0x480 <4> [394.602510] ? __pfx_kthread+0x10/0x10 <4> [394.602515] ret_from_fork_asm+0x1a/0x30 <4> [394.602527] </TASK> <4> [394.602529] irq event stamp: 426989 <4> [394.602531] hardirqs last enabled at (426995): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.602535] hardirqs last disabled at (427000): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.602538] softirqs last enabled at (425522): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.602541] softirqs last disabled at (425520): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.602544] ---[ end trace 0000000000000000 ]--- <6> [394.602547] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.602653] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.602662] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.602848] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.603174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.603300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.603394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.603480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.603564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.603646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.603757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.603884] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.604039] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.604193] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.605271] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.616000] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.616254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.617303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.617382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.617456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.617532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.617607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.617720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.617831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.617968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.618077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.618187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.618288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.618364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.618438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.618511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.618589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.618699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.618806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.618932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.619037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.619156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.619277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.619368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.619448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.619523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.619596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.619676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.619788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.619930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.620045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.620160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.620277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.620384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.620469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.620551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.620632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.620727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.620846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.620986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.621098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.621211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.621331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.621411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.621487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.621560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.621639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.621745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.621856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.621999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.622112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.622227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.622342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.622446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.622542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.622628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.622707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.622783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.622856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.622941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.623016] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.623193] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.623198] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87457, lrc_seqno=87457, guc_id=0, flags=0x73 in no process [-1] <7> [394.623200] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.623260] ------------[ cut here ]------------ <4> [394.623261] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.623262] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3607 <4> [394.623333] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.623392] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.623397] CPU: 7 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.623400] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.623401] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.623402] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.623407] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.623476] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.623478] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.623480] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.623481] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.623483] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.623484] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.623485] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.623487] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.623489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.623490] CR2: 00007021e33f8000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [394.623492] PKRU: 55555554 <4> [394.623493] Call Trace: <4> [394.623494] <TASK> <4> [394.623498] ? lock_acquire+0x20/0x2f0 <4> [394.623504] ? lock_release+0xd0/0x2b0 <4> [394.623509] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.623515] process_one_work+0x239/0x760 <4> [394.623521] worker_thread+0x200/0x3f0 <4> [394.623524] ? __pfx_worker_thread+0x10/0x10 <4> [394.623526] kthread+0x10d/0x150 <4> [394.623529] ? __pfx_kthread+0x10/0x10 <4> [394.623533] ret_from_fork+0x3d4/0x480 <4> [394.623535] ? __pfx_kthread+0x10/0x10 <4> [394.623538] ret_from_fork_asm+0x1a/0x30 <4> [394.623545] </TASK> <4> [394.623547] irq event stamp: 430335 <4> [394.623548] hardirqs last enabled at (430341): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.623551] hardirqs last disabled at (430346): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.623553] softirqs last enabled at (429408): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.623556] softirqs last disabled at (429401): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.623558] ---[ end trace 0000000000000000 ]--- <6> [394.623560] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.623629] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.623635] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.624073] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.624287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.624371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.624457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.624537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.624616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.624694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.624772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.624847] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.624951] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.625064] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.626087] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.635886] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.636154] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.637317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.637397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.637471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.637545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.637618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.637690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.637763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.637834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.637913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.637984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.638052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.638122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.638191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.638261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.638332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.638402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.638472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.638542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.638614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.638693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.638771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.638846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.638929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.639002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.639072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.639142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.639213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.639286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.639359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.639431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.639501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.639573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.639651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.639728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.639805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.639884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.639959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.640031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.640101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.640172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.640243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.640315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.640384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.640453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.640529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.640601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.640673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.640744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.640818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.640892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.640962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.641036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.641106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.641177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.641246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.641321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.641394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.641465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.641538] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.641693] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.641697] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87457, lrc_seqno=87457, guc_id=0, flags=0x73 in no process [-1] <7> [394.641700] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.641760] ------------[ cut here ]------------ <4> [394.641760] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.641762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3607 <4> [394.641833] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.641896] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.641901] CPU: 7 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.641903] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.641904] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.641906] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.641911] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.641981] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.641983] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.641985] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.641986] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.641987] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.641988] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.641989] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.641991] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.641992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.641993] CR2: 00007021e33f8000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [394.641995] PKRU: 55555554 <4> [394.641996] Call Trace: <4> [394.641997] <TASK> <4> [394.642001] ? lock_acquire+0x20/0x2f0 <4> [394.642006] ? lock_release+0xd0/0x2b0 <4> [394.642011] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.642016] process_one_work+0x239/0x760 <4> [394.642022] worker_thread+0x200/0x3f0 <4> [394.642025] ? __pfx_worker_thread+0x10/0x10 <4> [394.642027] kthread+0x10d/0x150 <4> [394.642030] ? __pfx_kthread+0x10/0x10 <4> [394.642033] ret_from_fork+0x3d4/0x480 <4> [394.642035] ? __pfx_kthread+0x10/0x10 <4> [394.642038] ret_from_fork_asm+0x1a/0x30 <4> [394.642046] </TASK> <4> [394.642047] irq event stamp: 433823 <4> [394.642048] hardirqs last enabled at (433829): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.642050] hardirqs last disabled at (433834): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.642052] softirqs last enabled at (432842): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.642055] softirqs last disabled at (432837): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.642057] ---[ end trace 0000000000000000 ]--- <5> [394.643158] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87471, lrc_seqno=87471, guc_id=0, flags=0x73 in no process [-1] <7> [394.643094] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.643162] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.643194] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.643210] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.643227] ------------[ cut here ]------------ <4> [394.643228] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.643229] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:7/205 <4> [394.643304] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm <7> [394.643248] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [394.643315] gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile <7> [394.643331] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.643334] wmi_bmof <4> [394.643335] kvm_intel usbhid kvm <7> [394.643333] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.643337] hid <4> [394.643338] irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei <7> [394.643351] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.643356] spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry <7> [394.643356] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.643360] nls_iso8859_1 <4> [394.643361] intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.643372] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.643374] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.643375] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.643376] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [394.643391] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.643381] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.643453] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.643455] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.643457] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.643458] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.643460] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.643461] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.643462] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.643463] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [394.643464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.643466] CR2: 00007d9f251a804c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [394.643467] PKRU: 55555554 <4> [394.643468] Call Trace: <4> [394.643469] <TASK> <4> [394.643473] ? lock_acquire+0x20/0x2f0 <4> [394.643479] ? lock_release+0xd0/0x2b0 <4> [394.643484] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.643489] process_one_work+0x239/0x760 <4> [394.643496] worker_thread+0x200/0x3f0 <4> [394.643498] ? __pfx_worker_thread+0x10/0x10 <4> [394.643500] kthread+0x10d/0x150 <4> [394.643503] ? __pfx_kthread+0x10/0x10 <4> [394.643506] ret_from_fork+0x3d4/0x480 <4> [394.643508] ? __pfx_kthread+0x10/0x10 <4> [394.643511] ret_from_fork_asm+0x1a/0x30 <4> [394.643518] </TASK> <4> [394.643519] irq event stamp: 1344551 <4> [394.643521] hardirqs last enabled at (1344557): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.643523] hardirqs last disabled at (1344562): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.643525] softirqs last enabled at (1343452): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.643528] softirqs last disabled at (1343450): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.643530] ---[ end trace 0000000000000000 ]--- <6> [394.643531] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.643603] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.643609] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.643782] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.644005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.644099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.644193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.644280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.644366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.644449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.644531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.644610] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.644704] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.644817] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.645835] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.655894] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.656153] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.657181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.657287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.657368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.657445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.657527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.657602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.657684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.657757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.657829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.657910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.657981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.658082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.658157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.658228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.658306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.658376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.658455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.658526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.658596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.658676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.658754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.658833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.658949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.659032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.659117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.659195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.659282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.659362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.659442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.659520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.659597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.659695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.659783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.659868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.659966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.660047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.660127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.660204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.660283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.660360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.660439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.660512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.660587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.660658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.660732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.660807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.660877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.660966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.661039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.661109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.661184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.661257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.661330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.661401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.661472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.661543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.661612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.661681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.661755] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.661911] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.661916] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87471, lrc_seqno=87471, guc_id=0, flags=0x73 in no process [-1] <7> [394.661919] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.661978] ------------[ cut here ]------------ <4> [394.661979] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.661981] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:65/3630 <4> [394.662052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.662111] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.662116] CPU: 4 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.662119] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.662120] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.662121] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.662127] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.662196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.662198] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.662200] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.662202] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.662203] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.662204] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.662205] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.662206] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.662208] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.662209] CR2: 00007021e5a09b40 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [394.662211] PKRU: 55555554 <4> [394.662212] Call Trace: <4> [394.662213] <TASK> <4> [394.662217] ? lock_acquire+0x20/0x2f0 <4> [394.662222] ? lock_release+0xd0/0x2b0 <4> [394.662227] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.662233] process_one_work+0x239/0x760 <4> [394.662239] worker_thread+0x200/0x3f0 <4> [394.662241] ? __pfx_worker_thread+0x10/0x10 <4> [394.662243] kthread+0x10d/0x150 <4> [394.662246] ? __pfx_kthread+0x10/0x10 <4> [394.662249] ret_from_fork+0x3d4/0x480 <4> [394.662251] ? __pfx_kthread+0x10/0x10 <4> [394.662254] ret_from_fork_asm+0x1a/0x30 <4> [394.662262] </TASK> <4> [394.662263] irq event stamp: 185157 <4> [394.662264] hardirqs last enabled at (185163): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.662266] hardirqs last disabled at (185168): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.662268] softirqs last enabled at (184350): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.662271] softirqs last disabled at (184343): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.662273] ---[ end trace 0000000000000000 ]--- <6> [394.662274] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.662344] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.662351] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.663602] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.663709] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.663812] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.664045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.664134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.664224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.664307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.664392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.664472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.664554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.664632] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.664725] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.664836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.665863] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.668964] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x30302d2e <7> [394.669104] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x30303031 <7> [394.675902] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.676154] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.677158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.677236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.677310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.677385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.677458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.677531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.677604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.677677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.677749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.677820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.677891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.677977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.678047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.678117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.678189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.678259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.678327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.678396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.678467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.678547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.678624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.678697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.678772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.678844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.678919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.678991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.679062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.679136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.679210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.679282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.679355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.679429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.679507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.679584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.679662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.679737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.679810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.679881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.679964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.680036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.680111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.680185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.680256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.680325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.680400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.680472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.680544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.680614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.680686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.680757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.680827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.680902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.680973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.681044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.681136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.681210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.681280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.681350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.681422] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.681570] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.681574] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87471, lrc_seqno=87471, guc_id=0, flags=0x73 in no process [-1] <7> [394.681577] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.681635] ------------[ cut here ]------------ <4> [394.681636] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.681638] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:42/3607 <4> [394.681709] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.681770] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.681776] CPU: 4 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.681778] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.681779] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.681781] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.681786] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.681855] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.681857] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.681859] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.681860] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.681862] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.681863] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.681864] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.681865] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000 <4> [394.681867] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.681868] CR2: 00007021e5a09b40 CR3: 000000012c104003 CR4: 0000000000f72ef0 <4> [394.681869] PKRU: 55555554 <4> [394.681870] Call Trace: <4> [394.681872] <TASK> <4> [394.681876] ? lock_acquire+0x20/0x2f0 <4> [394.681881] ? lock_release+0xd0/0x2b0 <4> [394.681886] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.681892] process_one_work+0x239/0x760 <4> [394.681902] worker_thread+0x200/0x3f0 <4> [394.681905] ? __pfx_worker_thread+0x10/0x10 <4> [394.681907] kthread+0x10d/0x150 <4> [394.681910] ? __pfx_kthread+0x10/0x10 <4> [394.681914] ret_from_fork+0x3d4/0x480 <4> [394.681916] ? __pfx_kthread+0x10/0x10 <4> [394.681919] ret_from_fork_asm+0x1a/0x30 <4> [394.681927] </TASK> <4> [394.681928] irq event stamp: 437401 <4> [394.681929] hardirqs last enabled at (437407): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.681932] hardirqs last disabled at (437412): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.681934] softirqs last enabled at (436344): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.681937] softirqs last disabled at (436339): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.681939] ---[ end trace 0000000000000000 ]--- <5> [394.682432] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87485, lrc_seqno=87485, guc_id=0, flags=0x73 in no process [-1] <7> [394.682484] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.682439] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.682540] ------------[ cut here ]------------ <7> [394.682537] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.682542] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.682557] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.682545] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:7/205 <7> [394.682615] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.682628] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core <7> [394.682650] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.682655] drm_kunit_helpers <7> [394.682650] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.682653] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.682657] i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.682729] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.682732] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.682733] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.682735] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.682742] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.682824] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.682825] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.682828] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.682830] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.682832] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.682833] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.682834] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.682835] FS: 0000000000000000(0000) GS:ffff8888dac98000(0000) knlGS:0000000000000000 <4> [394.682837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.682838] CR2: 000000062b8b0000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.682840] PKRU: 55555554 <4> [394.682841] Call Trace: <4> [394.682843] <TASK> <4> [394.682847] ? lock_acquire+0x20/0x2f0 <4> [394.682857] ? lock_release+0xd0/0x2b0 <4> [394.682862] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.682868] process_one_work+0x239/0x760 <4> [394.682875] worker_thread+0x200/0x3f0 <4> [394.682878] ? __pfx_worker_thread+0x10/0x10 <4> [394.682881] kthread+0x10d/0x150 <4> [394.682885] ? __pfx_kthread+0x10/0x10 <4> [394.682889] ret_from_fork+0x3d4/0x480 <4> [394.682892] ? __pfx_kthread+0x10/0x10 <4> [394.682895] ret_from_fork_asm+0x1a/0x30 <4> [394.682914] </TASK> <4> [394.682916] irq event stamp: 1346465 <4> [394.682919] hardirqs last enabled at (1346471): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.682925] hardirqs last disabled at (1346476): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.682929] softirqs last enabled at (1346454): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.682933] softirqs last disabled at (1346449): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.682937] ---[ end trace 0000000000000000 ]--- <6> [394.682941] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.683072] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.683100] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.683190] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.683294] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.683397] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.683631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.683724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.683816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.683909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.684016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.684097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.684219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.684300] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.684400] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.684516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.685564] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.695934] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.696217] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.697353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.697434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.697516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.697591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.697672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.697744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.697816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.697889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.697979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.698066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.698164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.698236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.698315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.698386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.698467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.698539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.698612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.698682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.698752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.698852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.698961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.699045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.699120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.699198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.699270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.699340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.699411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.699491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.699593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.699670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.699752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.699825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.699919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.700000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.700079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.700154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.700228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.700321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.700421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.700498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.700581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.700656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.700737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.700809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.700885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.700968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.701043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.701143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.701217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.701295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.701365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.701446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.701517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.701587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.701657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.701728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.701821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.701892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.701984] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.702138] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.702145] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87485, lrc_seqno=87485, guc_id=0, flags=0x73 in no process [-1] <7> [394.702149] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.702210] ------------[ cut here ]------------ <4> [394.702211] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.702212] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:65/3630 <4> [394.702285] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.702347] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.702353] CPU: 2 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.702356] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.702358] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.702359] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.702364] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.702434] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.702436] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.702438] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.702439] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.702441] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.702442] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.702443] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.702444] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [394.702446] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.702447] CR2: 00007d9f251a804c CR3: 000000012c104001 CR4: 0000000000f72ef0 <4> [394.702448] PKRU: 55555554 <4> [394.702449] Call Trace: <4> [394.702450] <TASK> <4> [394.702454] ? lock_acquire+0x20/0x2f0 <4> [394.702460] ? lock_release+0xd0/0x2b0 <4> [394.702465] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.702471] process_one_work+0x239/0x760 <4> [394.702477] worker_thread+0x200/0x3f0 <4> [394.702479] ? __pfx_worker_thread+0x10/0x10 <4> [394.702481] kthread+0x10d/0x150 <4> [394.702484] ? __pfx_kthread+0x10/0x10 <4> [394.702487] ret_from_fork+0x3d4/0x480 <4> [394.702489] ? __pfx_kthread+0x10/0x10 <4> [394.702492] ret_from_fork_asm+0x1a/0x30 <4> [394.702499] </TASK> <4> [394.702501] irq event stamp: 189085 <4> [394.702502] hardirqs last enabled at (189091): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.702504] hardirqs last disabled at (189096): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.702506] softirqs last enabled at (187974): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.702509] softirqs last disabled at (187967): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.702511] ---[ end trace 0000000000000000 ]--- <6> [394.702512] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.702593] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.702603] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.703013] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.703233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.703321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.703410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.703493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.703575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.703656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.703743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.703853] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.703959] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.704079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.705099] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.714920] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.715173] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.716150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.716229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.716344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.716422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.716496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.716577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.716650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.716729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.716801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.716872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.716957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.717027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.717102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.717207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.717279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.717349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.717428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.717499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.717579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.717659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.717738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.717814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.717892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.718015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.718089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.718169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.718242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.718322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.718397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.718470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.718543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.718615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.718715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.718804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.718883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.718978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.719054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.719136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.719212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.719283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.719357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.719427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.719533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.719611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.719686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.719767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.719838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.719924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.719999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.720070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.720139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.720213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.720315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.720388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.720459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.720542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.720615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.720693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.720769] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.721771] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.721775] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87485, lrc_seqno=87485, guc_id=0, flags=0x73 in no process [-1] <7> [394.721778] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.721841] ------------[ cut here ]------------ <4> [394.721842] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.721843] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:65/3630 <4> [394.721920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.722006] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.722012] CPU: 2 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.722015] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.722016] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.722018] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.722023] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.722091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.722093] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.722095] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.722097] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.722099] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.722100] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.722101] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.722103] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [394.722105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.722106] CR2: 00007d9f251a804c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [394.722108] PKRU: 55555554 <4> [394.722109] Call Trace: <4> [394.722110] <TASK> <4> [394.722114] ? lock_acquire+0x20/0x2f0 <4> [394.722120] ? lock_release+0xd0/0x2b0 <4> [394.722125] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.722131] process_one_work+0x239/0x760 <4> [394.722138] worker_thread+0x200/0x3f0 <4> [394.722140] ? __pfx_worker_thread+0x10/0x10 <4> [394.722143] kthread+0x10d/0x150 <4> [394.722146] ? __pfx_kthread+0x10/0x10 <4> [394.722149] ret_from_fork+0x3d4/0x480 <4> [394.722151] ? __pfx_kthread+0x10/0x10 <4> [394.722155] ret_from_fork_asm+0x1a/0x30 <4> [394.722162] </TASK> <4> [394.722163] irq event stamp: 192421 <4> [394.722164] hardirqs last enabled at (192427): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.722167] hardirqs last disabled at (192432): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.722170] softirqs last enabled at (191336): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.722172] softirqs last disabled at (191329): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.722174] ---[ end trace 0000000000000000 ]--- <7> [394.722189] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.722293] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [394.722640] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87499, lrc_seqno=87499, guc_id=0, flags=0x73 in no process [-1] <7> [394.722665] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.722645] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.722688] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.722702] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.722735] ------------[ cut here ]------------ <4> [394.722737] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.722756] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.722739] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:65/3630 <7> [394.722805] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.722809] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.722824] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper <7> [394.722830] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.722835] ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.722890] CPU: 2 UID: 0 PID: 3630 Comm: kworker/u64:65 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.722893] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.722894] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.722895] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.722900] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.722988] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.722990] RSP: 0018:ffffc90005517ca0 EFLAGS: 00010246 <4> [394.722993] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.722994] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.722996] RBP: ffffc90005517db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.722997] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.722998] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.723000] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000 <4> [394.723001] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.723003] CR2: 00007d9f251a804c CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [394.723005] PKRU: 55555554 <4> [394.723006] Call Trace: <4> [394.723007] <TASK> <4> [394.723011] ? lock_acquire+0x20/0x2f0 <4> [394.723016] ? lock_release+0xd0/0x2b0 <4> [394.723022] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.723029] process_one_work+0x239/0x760 <4> [394.723035] worker_thread+0x200/0x3f0 <4> [394.723038] ? __pfx_worker_thread+0x10/0x10 <4> [394.723040] kthread+0x10d/0x150 <4> [394.723043] ? __pfx_kthread+0x10/0x10 <4> [394.723047] ret_from_fork+0x3d4/0x480 <4> [394.723049] ? __pfx_kthread+0x10/0x10 <4> [394.723052] ret_from_fork_asm+0x1a/0x30 <4> [394.723060] </TASK> <4> [394.723061] irq event stamp: 193701 <4> [394.723062] hardirqs last enabled at (193707): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.723065] hardirqs last disabled at (193712): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.723067] softirqs last enabled at (193540): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.723070] softirqs last disabled at (193527): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.723072] ---[ end trace 0000000000000000 ]--- <6> [394.723074] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.723144] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.723150] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.723323] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.723545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.723637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.723730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.723816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.723901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.724008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.724092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.724171] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.724265] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.724378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.725423] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.736153] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.736402] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.737406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.737483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.737556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.737630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.737703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.737774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.737844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.737916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.738003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.738074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.738146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.738217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.738287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.738359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.738430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.738500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.738570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.738640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.738708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.738787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.738863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.738943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.739021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.739093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.739165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.739237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.739309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.739384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.739457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.739528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.739600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.739671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.739750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.739826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.739903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.739993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.740069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.740142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.740214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.740284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.740358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.740430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.740499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.740569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.740643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.740713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.740785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.740855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.740934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.741009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.741080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.741154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.741225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.741297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.741368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.741440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.741509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.741578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.741651] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.741798] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.741802] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87499, lrc_seqno=87499, guc_id=0, flags=0x73 in no process [-1] <7> [394.741805] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.741863] ------------[ cut here ]------------ <4> [394.741864] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.741866] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:45/3610 <4> [394.741943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.742007] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.742012] CPU: 11 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.742015] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.742016] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.742017] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.742022] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.742091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.742093] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.742095] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.742097] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.742098] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.742099] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.742100] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.742101] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.742103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.742104] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.742105] PKRU: 55555554 <4> [394.742106] Call Trace: <4> [394.742107] <TASK> <4> [394.742111] ? lock_acquire+0x20/0x2f0 <4> [394.742117] ? lock_release+0xd0/0x2b0 <4> [394.742122] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.742128] process_one_work+0x239/0x760 <4> [394.742134] worker_thread+0x200/0x3f0 <4> [394.742136] ? __pfx_worker_thread+0x10/0x10 <4> [394.742138] kthread+0x10d/0x150 <4> [394.742141] ? __pfx_kthread+0x10/0x10 <4> [394.742145] ret_from_fork+0x3d4/0x480 <4> [394.742146] ? __pfx_kthread+0x10/0x10 <4> [394.742149] ret_from_fork_asm+0x1a/0x30 <4> [394.742156] </TASK> <4> [394.742157] irq event stamp: 592007 <4> [394.742159] hardirqs last enabled at (592013): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.742161] hardirqs last disabled at (592018): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.742163] softirqs last enabled at (591020): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.742166] softirqs last disabled at (591015): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.742168] ---[ end trace 0000000000000000 ]--- <6> [394.743103] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.743175] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.743183] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.743237] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.743339] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.743440] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.743652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.743736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.743823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.743908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.744002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.744082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.744161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.744236] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.744328] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.744439] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.745451] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.755935] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.756184] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.757146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.757223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.757296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.757367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.757441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.757516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.757588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.757660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.757731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.757802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.757872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.757945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.758035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.758108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.758178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.758246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.758313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.758382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.758450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.758527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.758603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.758675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.758748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.758820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.758889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.758969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.759040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.759113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.759187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.759258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.759331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.759403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.759481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.759558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.759636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.759709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.759782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.759853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.759923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.760008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.760084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.760156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.760226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.760298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.760373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.760444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.760515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.760584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.760655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.760724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.760792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.760864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.760935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.761006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.761075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.761145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.761215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.761284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.761360] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.761521] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.761526] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87499, lrc_seqno=87499, guc_id=0, flags=0x73 in no process [-1] <7> [394.761528] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.761586] ------------[ cut here ]------------ <4> [394.761587] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.761591] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:45/3610 <4> [394.761663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.761733] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.761738] CPU: 11 UID: 0 PID: 3610 Comm: kworker/u64:45 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.761740] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.761741] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.761743] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.761748] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.761816] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.761818] RSP: 0018:ffffc9000226fca0 EFLAGS: 00010246 <4> [394.761820] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.761821] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.761822] RBP: ffffc9000226fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.761823] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.761824] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.761826] FS: 0000000000000000(0000) GS:ffff8888db218000(0000) knlGS:0000000000000000 <4> [394.761827] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.761828] CR2: 000059a552537000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [394.761830] PKRU: 55555554 <4> [394.761831] Call Trace: <4> [394.761832] <TASK> <4> [394.761835] ? lock_acquire+0x20/0x2f0 <4> [394.761841] ? lock_release+0xd0/0x2b0 <4> [394.761846] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.761851] process_one_work+0x239/0x760 <4> [394.761857] worker_thread+0x200/0x3f0 <4> [394.761860] ? __pfx_worker_thread+0x10/0x10 <4> [394.761862] kthread+0x10d/0x150 <4> [394.761864] ? __pfx_kthread+0x10/0x10 <4> [394.761868] ret_from_fork+0x3d4/0x480 <4> [394.761870] ? __pfx_kthread+0x10/0x10 <4> [394.761873] ret_from_fork_asm+0x1a/0x30 <4> [394.761880] </TASK> <4> [394.761881] irq event stamp: 595329 <4> [394.761882] hardirqs last enabled at (595335): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.761885] hardirqs last disabled at (595340): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.761887] softirqs last enabled at (594280): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.761889] softirqs last disabled at (594273): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.761891] ---[ end trace 0000000000000000 ]--- <5> [394.762429] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87513, lrc_seqno=87513, guc_id=0, flags=0x73 in no process [-1] <7> [394.762480] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.762438] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.762548] ------------[ cut here ]------------ <4> [394.762550] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [394.762571] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.762553] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:7/205 <7> [394.762587] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.762611] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.762632] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.762700] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.762707] CPU: 5 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.762712] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.762713] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <7> [394.762706] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.762714] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.762723] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [394.762762] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.762784] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <4> [394.762799] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.762801] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.762804] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.762805] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.762807] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.762808] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.762809] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.762811] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [394.762813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.762814] CR2: 00007d287d0b8520 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.762815] PKRU: 55555554 <4> [394.762816] Call Trace: <4> [394.762818] <TASK> <4> [394.762823] ? lock_acquire+0x20/0x2f0 <4> [394.762831] ? lock_release+0xd0/0x2b0 <4> [394.762836] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.762842] process_one_work+0x239/0x760 <4> [394.762849] worker_thread+0x200/0x3f0 <4> [394.762851] ? __pfx_worker_thread+0x10/0x10 <4> [394.762853] kthread+0x10d/0x150 <4> [394.762856] ? __pfx_kthread+0x10/0x10 <4> [394.762859] ret_from_fork+0x3d4/0x480 <4> [394.762862] ? __pfx_kthread+0x10/0x10 <4> [394.762865] ret_from_fork_asm+0x1a/0x30 <4> [394.762873] </TASK> <4> [394.762874] irq event stamp: 1348515 <4> [394.762875] hardirqs last enabled at (1348521): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.762879] hardirqs last disabled at (1348526): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.762881] softirqs last enabled at (1347236): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.762883] softirqs last disabled at (1347234): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.762885] ---[ end trace 0000000000000000 ]--- <6> [394.762889] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.762990] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.763012] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.763312] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.763417] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.763521] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.763753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.763842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.763938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.764039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.764124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.764207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.764289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.764367] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.764460] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.764573] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.765587] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.775977] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.776228] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.777270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.777351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.777426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.777501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.777575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.777666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.777741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.777813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.777885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.777964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.778053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.778125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.778195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.778265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.778336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.778406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.778475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.778545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.778614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.778694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.778772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.778845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.778920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.779006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.779103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.779177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.779248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.779325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.779399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.779471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.779543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.779616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.779694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.779772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.779850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.779924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.780028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.780125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.780202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.780275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.780350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.780424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.780496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.780567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.780642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.780714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.780785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.780855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.780927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.781011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.781104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.781178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.781249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.781321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.781391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.781463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.781533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.781602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.781676] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.781807] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.781812] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87513, lrc_seqno=87513, guc_id=0, flags=0x73 in no process [-1] <7> [394.781814] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.781872] ------------[ cut here ]------------ <4> [394.781873] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.781874] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:7/205 <4> [394.781956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.782056] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.782061] CPU: 5 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.782064] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.782065] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.782066] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.782072] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.782140] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.782142] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.782144] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.782145] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.782147] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.782148] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.782149] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.782150] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [394.782152] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.782153] CR2: 00007d287d0b8520 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.782154] PKRU: 55555554 <4> [394.782155] Call Trace: <4> [394.782156] <TASK> <4> [394.782160] ? lock_acquire+0x20/0x2f0 <4> [394.782165] ? lock_release+0xd0/0x2b0 <4> [394.782170] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.782176] process_one_work+0x239/0x760 <4> [394.782182] worker_thread+0x200/0x3f0 <4> [394.782184] ? __pfx_worker_thread+0x10/0x10 <4> [394.782187] kthread+0x10d/0x150 <4> [394.782189] ? __pfx_kthread+0x10/0x10 <4> [394.782193] ret_from_fork+0x3d4/0x480 <4> [394.782194] ? __pfx_kthread+0x10/0x10 <4> [394.782198] ret_from_fork_asm+0x1a/0x30 <4> [394.782205] </TASK> <4> [394.782206] irq event stamp: 1351913 <4> [394.782207] hardirqs last enabled at (1351919): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.782209] hardirqs last disabled at (1351924): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.782211] softirqs last enabled at (1351164): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.782213] softirqs last disabled at (1351159): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.782215] ---[ end trace 0000000000000000 ]--- <6> [394.782217] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.782286] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.782292] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.782704] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.782916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.783011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.783128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.783218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.783301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.783383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.783464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.783542] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.783635] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.783749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.784761] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.794953] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.795201] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.796216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.796295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.796369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.796443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.796517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.796590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.796663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.796737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.796811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.796883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.796961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.797048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.797119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.797187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.797257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.797325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.797395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.797463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.797530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.797608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.797685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.797758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.797833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.797904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.797987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.798085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.798160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.798235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.798310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.798382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.798455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.798527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.798605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.798682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.798761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.798836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.798909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.798991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.799085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.799159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.799234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.799306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.799377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.799446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.799520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.799590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.799660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.799729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.799800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.799869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.799937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.800024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.800119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.800192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.800264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.800335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.800404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.800473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.800546] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.800695] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.800699] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87513, lrc_seqno=87513, guc_id=0, flags=0x73 in no process [-1] <7> [394.800702] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.800760] ------------[ cut here ]------------ <4> [394.800761] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.800762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:7/205 <4> [394.800833] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.800892] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.800896] CPU: 5 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.800899] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.800900] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.800901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.800906] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.800985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.800987] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.800989] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.800990] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.800992] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.800993] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.800994] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.800996] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [394.800997] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.800999] CR2: 00007d287d0b8520 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.801000] PKRU: 55555554 <4> [394.801001] Call Trace: <4> [394.801002] <TASK> <4> [394.801009] ? lock_acquire+0x20/0x2f0 <4> [394.801017] ? lock_release+0xd0/0x2b0 <4> [394.801026] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.801036] process_one_work+0x239/0x760 <4> [394.801046] worker_thread+0x200/0x3f0 <4> [394.801051] ? __pfx_worker_thread+0x10/0x10 <4> [394.801055] kthread+0x10d/0x150 <4> [394.801059] ? __pfx_kthread+0x10/0x10 <4> [394.801065] ret_from_fork+0x3d4/0x480 <4> [394.801068] ? __pfx_kthread+0x10/0x10 <4> [394.801073] ret_from_fork_asm+0x1a/0x30 <4> [394.801086] </TASK> <4> [394.801088] irq event stamp: 1355225 <4> [394.801090] hardirqs last enabled at (1355231): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.801094] hardirqs last disabled at (1355236): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.801097] softirqs last enabled at (1354056): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.801101] softirqs last disabled at (1354051): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.801104] ---[ end trace 0000000000000000 ]--- <7> [394.802769] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802770] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802771] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802783] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802784] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802792] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.802784] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.802897] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [394.803020] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87527, lrc_seqno=87527, guc_id=0, flags=0x73 in no process [-1] <7> [394.803025] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.803089] ------------[ cut here ]------------ <4> [394.803090] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.803092] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:7/205 <4> [394.803165] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.803226] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.803230] CPU: 5 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.803233] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.803234] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.803235] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.803240] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.803311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.803313] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.803315] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.803316] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.803317] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.803318] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.803319] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.803321] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [394.803322] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.803323] CR2: 00007d287d0b8520 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.803325] PKRU: 55555554 <4> [394.803326] Call Trace: <4> [394.803327] <TASK> <4> [394.803330] ? lock_acquire+0x20/0x2f0 <4> [394.803336] ? lock_release+0xd0/0x2b0 <4> [394.803341] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.803346] process_one_work+0x239/0x760 <4> [394.803352] worker_thread+0x200/0x3f0 <4> [394.803355] ? __pfx_worker_thread+0x10/0x10 <4> [394.803357] kthread+0x10d/0x150 <4> [394.803360] ? __pfx_kthread+0x10/0x10 <4> [394.803363] ret_from_fork+0x3d4/0x480 <4> [394.803365] ? __pfx_kthread+0x10/0x10 <4> [394.803368] ret_from_fork_asm+0x1a/0x30 <4> [394.803375] </TASK> <4> [394.803376] irq event stamp: 1356647 <4> [394.803377] hardirqs last enabled at (1356653): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.803380] hardirqs last disabled at (1356658): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.803382] softirqs last enabled at (1354056): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.803384] softirqs last disabled at (1354051): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.803386] ---[ end trace 0000000000000000 ]--- <6> [394.803388] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.803459] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.803466] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.803918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.804201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.804336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.804471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.804602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.804730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.804858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.804994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.805123] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.805262] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.805423] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.806812] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.816964] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.817273] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.818422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.818540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.818656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.818774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.818892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.819017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.819135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.819252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.819370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.819487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.819604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.819721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.819838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.819960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.820079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.820196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.820313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.820441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.820530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.820615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.820695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.820771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.820846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.820919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.821001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.821074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.821145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.821219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.821292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.821363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.821436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.821508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.821585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.821661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.821739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.821813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.821887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.821962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.822033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.822103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.822176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.822245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.822316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.822384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.822457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.822528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.822597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.822666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.822736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.822806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.822875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.822947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.823029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.823100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.823168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.823238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.823306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.823374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.823445] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.823594] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.823599] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87527, lrc_seqno=87527, guc_id=0, flags=0x73 in no process [-1] <7> [394.823601] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.823659] ------------[ cut here ]------------ <4> [394.823660] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.823662] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:55/3620 <4> [394.823732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.823792] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.823797] CPU: 7 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.823800] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.823801] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.823802] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.823807] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.823876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.823877] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.823879] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.823881] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.823882] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.823883] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.823884] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.823885] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.823887] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.823888] CR2: 00007021e33f8000 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [394.823889] PKRU: 55555554 <4> [394.823890] Call Trace: <4> [394.823891] <TASK> <4> [394.823895] ? lock_acquire+0x20/0x2f0 <4> [394.823900] ? lock_release+0xd0/0x2b0 <4> [394.823905] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.823911] process_one_work+0x239/0x760 <4> [394.823917] worker_thread+0x200/0x3f0 <4> [394.823920] ? __pfx_worker_thread+0x10/0x10 <4> [394.823922] kthread+0x10d/0x150 <4> [394.823924] ? __pfx_kthread+0x10/0x10 <4> [394.823928] ret_from_fork+0x3d4/0x480 <4> [394.823930] ? __pfx_kthread+0x10/0x10 <4> [394.823933] ret_from_fork_asm+0x1a/0x30 <4> [394.823940] </TASK> <4> [394.823941] irq event stamp: 477927 <4> [394.823942] hardirqs last enabled at (477933): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.823945] hardirqs last disabled at (477938): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.823947] softirqs last enabled at (476606): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.823950] softirqs last disabled at (476599): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.823952] ---[ end trace 0000000000000000 ]--- <6> [394.823954] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.824040] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.824046] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.824450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.824663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.824746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.824832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.824914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.825003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.825081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.825162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.825239] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.825333] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.825444] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.826463] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.836990] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.837239] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.838243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.838319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.838392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.838466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.838539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.838611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.838682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.838754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.838824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.838894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.838969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.839040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.839109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.839179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.839249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.839318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.839389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.839458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.839527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.839605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.839683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.839758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.839831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.839903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.839977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.840047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.840116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.840190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.840262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.840335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.840410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.840483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.840560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.840638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.840715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.840788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.840860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.840929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.841008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.841076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.841148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.841219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.841289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.841357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.841429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.841498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.841567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.841636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.841706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.841774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.841842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.841913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.841986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.842055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.842123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.842193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.842260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.842328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.842399] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.842542] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.842547] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87527, lrc_seqno=87527, guc_id=0, flags=0x73 in no process [-1] <7> [394.842549] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.842606] ------------[ cut here ]------------ <4> [394.842607] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.842609] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:55/3620 <4> [394.842678] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.842737] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.842742] CPU: 7 UID: 0 PID: 3620 Comm: kworker/u64:55 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.842745] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.842746] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.842747] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.842752] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.842821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.842822] RSP: 0018:ffffc90001a73ca0 EFLAGS: 00010246 <4> [394.842824] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.842825] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.842827] RBP: ffffc90001a73db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.842828] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.842829] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.842830] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.842831] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.842833] CR2: 00007021e33f8000 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [394.842834] PKRU: 55555554 <4> [394.842835] Call Trace: <4> [394.842836] <TASK> <4> [394.842840] ? lock_acquire+0x20/0x2f0 <4> [394.842845] ? lock_release+0xd0/0x2b0 <4> [394.842850] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.842856] process_one_work+0x239/0x760 <4> [394.842861] worker_thread+0x200/0x3f0 <4> [394.842864] ? __pfx_worker_thread+0x10/0x10 <4> [394.842866] kthread+0x10d/0x150 <4> [394.842869] ? __pfx_kthread+0x10/0x10 <4> [394.842872] ret_from_fork+0x3d4/0x480 <4> [394.842874] ? __pfx_kthread+0x10/0x10 <4> [394.842877] ret_from_fork_asm+0x1a/0x30 <4> [394.842884] </TASK> <4> [394.842885] irq event stamp: 481251 <4> [394.842886] hardirqs last enabled at (481257): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.842889] hardirqs last disabled at (481262): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.842891] softirqs last enabled at (480292): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.842893] softirqs last disabled at (480285): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.842895] ---[ end trace 0000000000000000 ]--- <7> [394.843433] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.843521] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.843537] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.843551] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.843653] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.843650] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <7> [394.843743] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 16; Own pages: 0. <5> [394.844250] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87541, lrc_seqno=87541, guc_id=0, flags=0x73 in no process [-1] <7> [394.844253] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [394.844238] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [394.844315] ------------[ cut here ]------------ <4> [394.844315] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.844317] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:7/205 <4> [394.844389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog <7> [394.844345] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [394.844392] mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.844452] CPU: 5 UID: 0 PID: 205 Comm: kworker/u64:7 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.844455] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.844457] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.844458] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.844463] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.844532] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.844534] RSP: 0018:ffffc900014d3ca0 EFLAGS: 00010246 <4> [394.844536] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.844537] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.844538] RBP: ffffc900014d3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.844539] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.844540] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.844542] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000 <4> [394.844543] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.844544] CR2: 00007d287d0b8520 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [394.844546] PKRU: 55555554 <4> [394.844547] Call Trace: <4> [394.844548] <TASK> <4> [394.844551] ? lock_acquire+0x20/0x2f0 <4> [394.844557] ? lock_release+0xd0/0x2b0 <4> [394.844562] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.844567] process_one_work+0x239/0x760 <4> [394.844573] worker_thread+0x200/0x3f0 <4> [394.844576] ? __pfx_worker_thread+0x10/0x10 <4> [394.844578] kthread+0x10d/0x150 <4> [394.844581] ? __pfx_kthread+0x10/0x10 <4> [394.844584] ret_from_fork+0x3d4/0x480 <4> [394.844586] ? __pfx_kthread+0x10/0x10 <4> [394.844589] ret_from_fork_asm+0x1a/0x30 <4> [394.844596] </TASK> <4> [394.844597] irq event stamp: 1358767 <4> [394.844598] hardirqs last enabled at (1358773): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.844601] hardirqs last disabled at (1358778): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.844603] softirqs last enabled at (1357774): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70 <4> [394.844605] softirqs last disabled at (1357772): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120 <4> [394.844607] ---[ end trace 0000000000000000 ]--- <6> [394.844609] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.844677] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.844684] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.845095] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.845359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.845487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.845620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.845748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.845877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.846010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.846142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.846270] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.846407] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.846567] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.847959] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.857981] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.858289] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.859449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.859566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.859682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.859800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.859917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.860048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.860168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.860284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.860401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.860518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.860636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.860753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.860870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.860993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.861113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.861230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.861349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.861467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.861584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.861708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.861829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.861949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.862076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.862198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.862319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.862440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [394.862561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [394.862686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [394.862810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [394.862934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [394.863062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [394.863188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [394.863317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [394.863446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [394.863575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [394.863701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [394.863827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [394.863949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [394.864075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [394.864198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [394.864322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [394.864444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [394.864565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [394.864686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [394.864811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [394.864933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [394.865060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [394.865183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [394.865306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [394.865428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [394.865548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [394.865672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [394.865795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [394.865916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [394.866040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [394.866165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [394.866286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [394.866406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [394.866531] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [394.866731] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [394.866735] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=87541, lrc_seqno=87541, guc_id=0, flags=0x73 in no process [-1] <7> [394.866737] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [394.866798] ------------[ cut here ]------------ <4> [394.866799] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [394.866800] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3607 <4> [394.866873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse <4> [394.866931] efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test] <4> [394.866935] CPU: 7 UID: 0 PID: 3607 Comm: kworker/u64:42 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-pw-161761v2-debug+ #1 PREEMPT(lazy) <4> [394.866938] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [394.866939] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [394.866940] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [394.866945] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [394.867027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [394.867028] RSP: 0018:ffffc90005477ca0 EFLAGS: 00010246 <4> [394.867031] RAX: ffffffffa11ff33f RBX: 0000000000000000 RCX: 0000000000000000 <4> [394.867032] RDX: ffff8881017b6490 RSI: ffffffffa11ff33f RDI: ffffffffa1003dd0 <4> [394.867033] RBP: ffffc90005477db0 R08: 0000000000000000 R09: 0000000000000000 <4> [394.867035] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [394.867036] R13: ffff8881017b6490 R14: ffff88812758e818 R15: 00000000ffffffc2 <4> [394.867037] FS: 0000000000000000(0000) GS:ffff8888db018000(0000) knlGS:0000000000000000 <4> [394.867038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [394.867040] CR2: 00007021e33f8000 CR3: 000000013e95d001 CR4: 0000000000f72ef0 <4> [394.867041] PKRU: 55555554 <4> [394.867043] Call Trace: <4> [394.867044] <TASK> <4> [394.867048] ? lock_acquire+0x20/0x2f0 <4> [394.867053] ? lock_release+0xd0/0x2b0 <4> [394.867058] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [394.867064] process_one_work+0x239/0x760 <4> [394.867070] worker_thread+0x200/0x3f0 <4> [394.867073] ? __pfx_worker_thread+0x10/0x10 <4> [394.867075] kthread+0x10d/0x150 <4> [394.867078] ? __pfx_kthread+0x10/0x10 <4> [394.867082] ret_from_fork+0x3d4/0x480 <4> [394.867083] ? __pfx_kthread+0x10/0x10 <4> [394.867087] ret_from_fork_asm+0x1a/0x30 <4> [394.867094] </TASK> <4> [394.867095] irq event stamp: 450911 <4> [394.867096] hardirqs last enabled at (450917): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0 <4> [394.867099] hardirqs last disabled at (450922): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0 <4> [394.867101] softirqs last enabled at (450750): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.867103] softirqs last disabled at (450741): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160 <4> [394.867105] ---[ end trace 0000000000000000 ]--- <6> [394.867107] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [394.867177] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [394.867183] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [394.868418] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [394.868524] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [394.868625] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [394.868846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [394.868938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [394.869043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [394.869128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [394.869224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [394.869306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [394.869387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [394.869467] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [394.869560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [394.869673] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [394.870682] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [394.881333] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [394.881582] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [394.882583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [394.882663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [394.882736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [394.882810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [394.882882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [394.882952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [394.883035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [394.883106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [394.883177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [394.883247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [394.883317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [394.883386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [394.883456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [394.883526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [394.883614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [394.883685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [394.883755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [394.883825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [394.883896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [394.883975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [394.884065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [394.884140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [394.884214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [394.884286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [394.884357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [394.884429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01

<4> [393.503749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.504615] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.508403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.508799] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.529045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.529193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.548809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.548955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.550480] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.550619] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.569231] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.569375] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.589244] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.589390] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.590852] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.591007] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.609194] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.609335] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.629181] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.629326] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.630927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1

<4> [393.631140] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.649365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.649522] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.668662] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.668803] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.670305] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.670444] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.689248] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.689393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.708357] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.708502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.709344] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.709538] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.728715] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.728858] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.747217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.747359] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.748818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.748960] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.768323] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.768465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.788718] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.788862] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.789815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.789989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.808355] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.808497] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.827362] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.827503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.828862] drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp

<4> [393.828897] binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [393.829000] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.847307] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.847449] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.867358] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.867505] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.868434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.868762] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.887750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.887905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.907449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.907606] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.909184] snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [393.909331] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.927381] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.927525] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.947342] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.947485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.948346] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.948523] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.967444] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.967586] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.987442] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [393.987586] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [393.988546] drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [393.988751] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.007823] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.007977] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.027536] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.027710] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.028822] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.029028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.047519] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.047673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.067387] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.067535] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.068512] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.068732] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.088217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.088358] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.106421] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.106561] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.107196] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr

<4> [394.107228] intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [394.107399] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.126401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.126880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.145809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.145950] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.146907] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.147103] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.166830] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.166987] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.185708] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.185859] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.186743] drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer

<4> [394.186938] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.205490] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.205630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.224581] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.224729] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.226828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.226989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.245734] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.245898] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.264921] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.265066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.266749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.266889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.287778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.287937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.306969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.307115] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.308769] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.308989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.331828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.332046] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.355013] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.355166] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.356201] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.356502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.375781] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.375932] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.395685] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.395844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.397492] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.397633] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.417118] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.417266] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.436757] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.436909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.438403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.438547] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.457565] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.457709] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.478199] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.478347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.479956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.480099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.498832] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.499069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.520880] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.521029] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.522621] snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart

<4> [394.522647] asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [394.522777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.541853] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.542011] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.560571] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.560721] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.561949] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.562096] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.580696] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.580838] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.600667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.600809] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.602236] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common

<4> [394.602256] intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei

<4> [394.602417] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.623333] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.623476] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.641833] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.641981] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.643315] gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile

<4> [394.643338] irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei

<4> [394.643453] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.662052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.662196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.681709] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.681855] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.682628] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core

<4> [394.682657] i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [394.682824] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.702285] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.702434] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.721920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.722091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.722835] ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [394.722988] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.741943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.742091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.761663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.761816] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.762632] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.762799] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.781956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.782140] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.800833] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.800985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.803165] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.803311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.823732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.823876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.842678] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.842821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.844392] mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]

<4> [394.844532] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [394.866873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart asus_nb_wmi spi_nor coretemp asus_wmi mei_hdcp mei_pxp mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass snd_hda_intel ghash_clmulni_intel snd_intel_dspcfg snd_hda_codec aesni_intel r8169 rapl intel_cstate snd_hda_core snd_hwdep video realtek snd_pcm binfmt_misc i2c_i801 snd_timer snd i2c_mux idma64 mei_me spi_intel_pci i2c_smbus soundcore mei spi_intel intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry nls_iso8859_1 intel_vsec pinctrl_alderlake acpi_pad acpi_tad wmi dm_multipath msr nvme_fabrics fuse

<4> [394.867027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@xe_exec_system_allocator@process-many-stride-malloc-prefetch