igt@xe_compute_preempt@compute-preempt-many-vram-evict@engine-drm_xe_engine_class_compute on shard-bmg@IGT

Detail	Value
Duration	unknown
Hostname	shard-bmg-10
Igt-Version	IGT-Version: 2.3-g726612327 (x86_64) (Linux: 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ x86_64)
Out	Using IGT_SRANDOM=1768251331 for randomisation Opened device: /dev/dri/card0 Starting subtest: compute-preempt-many-vram-evict Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:404 bo_execenv_sync() #3 ../lib/intel_compute.c:2273 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2398 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #8 [__libc_init_first+0x8a] #9 [__libc_start_main+0x8b] #10 [_start+0x25] Stack trace: Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #0 ../lib/igt_core.c:2075 __igt_fail_assert() Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (1.664s) Subtest compute-preempt-many-vram-evict: FAIL (1.665s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: compute-preempt-many-vram-evict Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: error: -5 != 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. ** DEBUG (xe_compute_preempt:8005) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7023f4e12000, addr: 83e0000, size: 1000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7023f2a85000, addr: 300000, size: 100000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7023f2a75000, addr: 200000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7023f2a65000, addr: 63d0000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7023f2a55000, addr: 40000000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7023f2a45000, addr: 80000000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7023f2945000, addr: 6000000, size: 100000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7023f2935000, addr: 210000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7023f2925000, addr: 100000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7023ec525000, addr: 9000000, size: 6400000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7023ec51d000, addr: 107ff0000, size: 8000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7023f46ac000, addr: 83e0000, size: 1000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7023ec41d000, addr: 300000, size: 100000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7023ec40d000, addr: 200000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7023ec3fd000, addr: 63d0000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7023ec3ed000, addr: 40000000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7023ec3dd000, addr: 80000000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7023ec2dd000, addr: 6000000, size: 100000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7023ec2cd000, addr: 210000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7023ec2bd000, addr: 100000, size: 10000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7023e5ebd000, addr: 9000000, size: 6400000 (xe_compute_preempt:8036) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7023e5eb5000, addr: 107ff0000, size: 8000 (xe_compute_preempt:8036) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:8036) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:8036) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:8036) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:8036) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:8036) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:8036) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:8036) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:8036) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:8036) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:8036) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:8036) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:8036) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:8036) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:8036) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:8036) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:8036) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:8036) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:8036) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:8036) igt_core-INFO: Stack trace: (xe_compute_preempt:8036) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:8036) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_compute_preempt:8036) igt_core-INFO: #2 ../lib/intel_compute.c:404 bo_execenv_sync() (xe_compute_preempt:8036) igt_core-INFO: #3 ../lib/intel_compute.c:2273 xe2lpg_compute_preempt_exec() (xe_compute_preempt:8036) igt_core-INFO: #4 ../lib/intel_compute.c:2398 run_intel_compute_kernel_preempt() (xe_compute_preempt:8036) igt_core-INFO: #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() (xe_compute_preempt:8036) igt_core-INFO: #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() (xe_compute_preempt:8036) igt_core-INFO: #7 ../tests/intel/xe_compute_preempt.c:65 main() (xe_compute_preempt:8036) igt_core-INFO: #8 [__libc_init_first+0x8a] (xe_compute_preempt:8036) igt_core-INFO: #9 [__libc_start_main+0x8b] (xe_compute_preempt:8036) igt_core-INFO: #10 [_start+0x25] END (xe_compute_preempt:8006) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:8006) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:8006) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:8006) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:8010) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:712: (xe_compute_preempt:8010) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:8010) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:8010) xe/xe_ioctl-CRITICAL: error: -5 != 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. DEBUG (xe_compute_preempt:8005) DEBUG: VRAM: 12216, child count: 73 END ** Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (1.664s) Subtest compute-preempt-many-vram-evict: FAIL (1.665s)
Dmesg Scroll to first warning	<6> [581.199934] Console: switching to colour dummy device 80x25 <6> [581.200227] [IGT] xe_compute_preempt: executing <7> [581.314962] xe 0000:03:00.0: [drm:drm_pagemap_shrinker_scan [drm_gpusvm_helper]] Shrinking dpagemap ffff88812dbd4ad0. <6> [581.342429] [IGT] xe_compute_preempt: starting subtest compute-preempt-many-vram-evict <6> [581.343220] [IGT] xe_compute_preempt: starting dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE <6> [581.766816] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x000060d418800000 FaultType: 0 AccessType: 0 FaultLevel: 3 EngineClass: 3 bcs EngineInstance: 8 <6> [581.766836] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [581.767232] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [581.770994] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <6> [581.772152] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [581.772780] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20082, lrc_seqno=20082, guc_id=0, flags=0x73 in no process [-1] <6> [581.813945] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [581.814000] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [581.814007] ------------[ cut here ]------------ <4> [581.814010] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.814011] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#6: kworker/u64:30/6373 <4> [581.814187] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.814301] efi_pstore nfnetlink autofs4 <4> [581.814308] CPU: 6 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.814313] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [581.814315] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.814317] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.814325] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.814442] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.814446] RSP: 0000:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [581.814449] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.814452] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.814453] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.814455] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c1240 <4> [581.814456] R13: 0000000000000000 R14: 00000000fffffffb R15: ffff888104e18e10 <4> [581.814458] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [581.814460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.814461] CR2: 00007023f2245000 CR3: 000000011586a003 CR4: 0000000000f72ef0 <4> [581.814463] PKRU: 55555554 <4> [581.814466] Call Trace: <4> [581.814468] <TASK> <4> [581.814476] ? lock_acquire+0xc4/0x2c0 <4> [581.814487] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [581.814496] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.814505] process_one_work+0x22e/0x6b0 <4> [581.814517] worker_thread+0x1e8/0x3d0 <4> [581.814525] ? __pfx_worker_thread+0x10/0x10 <4> [581.814528] kthread+0x11f/0x250 <4> [581.814533] ? __pfx_kthread+0x10/0x10 <4> [581.814538] ret_from_fork+0x344/0x3a0 <4> [581.814545] ? __pfx_kthread+0x10/0x10 <4> [581.814551] ret_from_fork_asm+0x1a/0x30 <4> [581.814565] </TASK> <4> [581.814567] irq event stamp: 197041 <4> [581.814569] hardirqs last enabled at (197047): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.814573] hardirqs last disabled at (197052): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.814577] softirqs last enabled at (196260): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.814582] softirqs last disabled at (196255): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.814584] ---[ end trace 0000000000000000 ]--- <6> [581.814588] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.814733] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [581.815174] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.815254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.818298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.818521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.818744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.818884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.819067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.819267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.819463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.819612] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.819805] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.820190] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.822089] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [581.832909] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [581.835430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [581.840868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [581.841332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [581.841537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [581.841677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [581.841875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [581.842023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [581.842182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [581.842368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [581.842838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [581.843144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [581.843242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [581.843424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [581.843617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [581.844244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [581.844387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [581.844537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [581.844676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [581.844839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [581.845082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [581.845199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [581.845316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [581.845428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [581.845540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [581.845649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [581.845788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [581.845900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [581.846635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [581.846784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [581.846997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [581.847142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [581.847263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [581.847524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [581.847678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [581.848540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [581.848676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [581.848794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [581.848909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [581.849020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [581.849131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [581.849244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [581.849355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [581.849473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [581.849582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [581.849707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [581.849818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [581.849930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [581.850043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [581.850155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [581.850263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [581.850371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [581.850487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [581.850605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [581.850728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [581.850837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [581.850950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [581.851071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [581.851226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [581.851339] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [581.854678] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [581.856475] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=4, flags=0x0 in xe_compute_pree [8005] <7> [581.856479] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.857387] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=8, flags=0x0 in xe_compute_pree [8005] <7> [581.857394] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.857537] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20082, lrc_seqno=20082, guc_id=0, flags=0x73 in no process [-1] <7> [581.857543] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [581.857566] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [581.857875] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [581.858133] ------------[ cut here ]------------ <4> [581.858135] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.858136] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:30/6373 <4> [581.858225] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.858291] efi_pstore nfnetlink autofs4 <4> [581.858296] CPU: 10 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.858299] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.858300] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.858302] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.858308] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.858380] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.858382] RSP: 0000:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [581.858384] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.858385] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.858387] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.858388] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c1240 <4> [581.858389] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.858390] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [581.858391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.858393] CR2: 00007023f2b85000 CR3: 0000000113002002 CR4: 0000000000f72ef0 <4> [581.858394] PKRU: 55555554 <4> [581.858395] Call Trace: <4> [581.858396] <TASK> <4> [581.858400] ? lock_acquire+0xc4/0x2c0 <4> [581.858405] ? find_held_lock+0x31/0x90 <4> [581.858408] ? lock_release+0xce/0x280 <4> [581.858413] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.858419] process_one_work+0x22e/0x6b0 <4> [581.858426] worker_thread+0x1e8/0x3d0 <4> [581.858428] ? __pfx_worker_thread+0x10/0x10 <4> [581.858430] kthread+0x11f/0x250 <4> [581.858434] ? __pfx_kthread+0x10/0x10 <4> [581.858437] ret_from_fork+0x344/0x3a0 <4> [581.858439] ? __pfx_kthread+0x10/0x10 <4> [581.858442] ret_from_fork_asm+0x1a/0x30 <4> [581.858450] </TASK> <4> [581.858451] irq event stamp: 206957 <4> [581.858452] hardirqs last enabled at (206963): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.858455] hardirqs last disabled at (206968): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.858457] softirqs last enabled at (206184): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.858460] softirqs last disabled at (205011): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.858462] ---[ end trace 0000000000000000 ]--- <6> [581.858465] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.858536] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [581.858693] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=12, flags=0x0 in xe_compute_pree [8005] <7> [581.858697] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.858829] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=20, flags=0x0 in xe_compute_pree [8005] <7> [581.858834] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.859099] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=28, flags=0x0 in xe_compute_pree [8005] <7> [581.859103] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.859224] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=32, flags=0x0 in xe_compute_pree [8005] <7> [581.859231] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.859381] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=44, flags=0x0 in xe_compute_pree [8005] <7> [581.859386] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [581.859730] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.859806] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.860603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.860703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.860822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.860926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.861021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.861113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.861236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.861329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.861423] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.861583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.862798] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [581.872705] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [581.872967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [581.874283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [581.874411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [581.874529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [581.874647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [581.874773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [581.874890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [581.875006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [581.875122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [581.875237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [581.875353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [581.875468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [581.875583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [581.875703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [581.875819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [581.875935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [581.876050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [581.876166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [581.876281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [581.876396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [581.876518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [581.876640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [581.876765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [581.876887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [581.877006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [581.877125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [581.877247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [581.877372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [581.877495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [581.877616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [581.877743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [581.877865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [581.877993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [581.878119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [581.878246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [581.878370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [581.878494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [581.878614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [581.878741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [581.878860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [581.878983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [581.879105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [581.879225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [581.879344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [581.879468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [581.879589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [581.879713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [581.879833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [581.879954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [581.880073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [581.880192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [581.880315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [581.880435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [581.880556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [581.880675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [581.880801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [581.880920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [581.881038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [581.881161] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [581.882553] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [581.882752] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20082, lrc_seqno=20082, guc_id=0, flags=0x73 in no process [-1] <7> [581.882759] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.883074] ------------[ cut here ]------------ <4> [581.883076] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.883079] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#5: kworker/u64:21/3726 <4> [581.883398] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.883475] efi_pstore nfnetlink autofs4 <4> [581.883479] CPU: 5 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.883482] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.883484] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.883485] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.883491] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.883563] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.883566] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [581.883569] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.883571] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.883573] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.883576] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c1240 <4> [581.883578] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.883580] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [581.883582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.883584] CR2: 00007023f2915000 CR3: 0000000003448002 CR4: 0000000000f72ef0 <4> [581.883586] PKRU: 55555554 <4> [581.883588] Call Trace: <4> [581.883590] <TASK> <4> [581.883596] ? lock_acquire+0xc4/0x2c0 <4> [581.883602] ? find_held_lock+0x31/0x90 <4> [581.883606] ? lock_release+0xce/0x280 <4> [581.883613] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.883623] process_one_work+0x22e/0x6b0 <4> [581.883635] worker_thread+0x1e8/0x3d0 <4> [581.883639] ? __pfx_worker_thread+0x10/0x10 <4> [581.883642] kthread+0x11f/0x250 <4> [581.883648] ? __pfx_kthread+0x10/0x10 <7> [581.883578] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [581.883653] ret_from_fork+0x344/0x3a0 <4> [581.883656] ? __pfx_kthread+0x10/0x10 <4> [581.883660] ret_from_fork_asm+0x1a/0x30 <4> [581.883672] </TASK> <4> [581.883674] irq event stamp: 465103 <4> [581.883675] hardirqs last enabled at (465109): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.883678] hardirqs last disabled at (465114): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.883681] softirqs last enabled at (462638): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.883684] softirqs last disabled at (462631): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.883694] ---[ end trace 0000000000000000 ]--- <7> [581.883864] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [581.888861] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20152, lrc_seqno=20152, guc_id=0, flags=0x73 in no process [-1] <7> [581.888867] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.888965] ------------[ cut here ]------------ <4> [581.888967] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.888970] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#3: kworker/u64:5/201 <4> [581.889077] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.889199] efi_pstore nfnetlink autofs4 <4> [581.889207] CPU: 3 UID: 0 PID: 201 Comm: kworker/u64:5 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.889212] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.889214] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.889216] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.889224] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.889328] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.889331] RSP: 0018:ffffc900014b3ca0 EFLAGS: 00010246 <4> [581.889335] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.889337] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.889339] RBP: ffffc900014b3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.889341] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea18340 <4> [581.889344] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.889346] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [581.889348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.889351] CR2: 00007023f2b85000 CR3: 000000011d399003 CR4: 0000000000f72ef0 <4> [581.889353] PKRU: 55555554 <4> [581.889355] Call Trace: <4> [581.889357] <TASK> <4> [581.889364] ? lock_acquire+0xc4/0x2c0 <4> [581.889371] ? find_held_lock+0x31/0x90 <4> [581.889376] ? lock_release+0xce/0x280 <4> [581.889385] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.889395] process_one_work+0x22e/0x6b0 <4> [581.889407] worker_thread+0x1e8/0x3d0 <4> [581.889411] ? __pfx_worker_thread+0x10/0x10 <4> [581.889415] kthread+0x11f/0x250 <4> [581.889421] ? __pfx_kthread+0x10/0x10 <4> [581.889426] ret_from_fork+0x344/0x3a0 <4> [581.889430] ? __pfx_kthread+0x10/0x10 <4> [581.889434] ret_from_fork_asm+0x1a/0x30 <4> [581.889449] </TASK> <4> [581.889450] irq event stamp: 1049117 <4> [581.889452] hardirqs last enabled at (1049123): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.889457] hardirqs last disabled at (1049128): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.889460] softirqs last enabled at (1044588): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.889464] softirqs last disabled at (1044581): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.889467] ---[ end trace 0000000000000000 ]--- <6> [581.889470] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.889576] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [581.889586] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.889607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.890346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.890440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.890551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.890675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.890819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.890926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.891035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.891142] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.891261] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.891438] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.892665] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [581.902717] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [581.903318] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [581.904803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [581.904882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [581.904957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [581.905035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [581.905213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [581.905301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [581.905379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [581.905465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [581.905548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [581.905632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [581.905748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [581.906069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [581.906176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [581.906260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [581.906341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [581.906428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [581.906519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [581.906594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [581.906680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [581.906771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [581.906851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [581.906927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [581.907005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [581.907081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [581.907156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [581.907233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [581.907315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [581.907396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [581.907479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [581.907567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [581.907647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [581.907776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [581.907882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [581.907970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [581.908052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [581.908131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [581.908207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [581.908282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [581.908356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [581.908434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [581.908510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [581.908585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [581.908658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [581.908743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [581.908817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [581.908891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [581.908964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [581.909044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [581.909122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [581.909198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [581.909277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [581.909352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [581.909428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [581.909502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [581.909578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [581.909651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [581.909729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [581.909806] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [581.911314] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [581.911737] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20152, lrc_seqno=20152, guc_id=0, flags=0x73 in no process [-1] <7> [581.911748] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.912192] ------------[ cut here ]------------ <4> [581.912195] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.912199] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:5/201 <4> [581.912482] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.912546] efi_pstore nfnetlink autofs4 <4> [581.912551] CPU: 2 UID: 0 PID: 201 Comm: kworker/u64:5 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.912554] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.912555] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.912556] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.912562] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.912659] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.912662] RSP: 0018:ffffc900014b3ca0 EFLAGS: 00010246 <4> [581.912665] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.912668] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.912670] RBP: ffffc900014b3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.912672] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea18340 <4> [581.912674] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <7> [581.912601] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [581.912676] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [581.912678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.912680] CR2: 00005f20fca5030c CR3: 0000000003448003 CR4: 0000000000f72ef0 <4> [581.912682] PKRU: 55555554 <4> [581.912683] Call Trace: <4> [581.912685] <TASK> <4> [581.912691] ? lock_acquire+0xc4/0x2c0 <4> [581.912696] ? find_held_lock+0x31/0x90 <4> [581.912709] ? lock_release+0xce/0x280 <4> [581.912718] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.912728] process_one_work+0x22e/0x6b0 <4> [581.912738] worker_thread+0x1e8/0x3d0 <4> [581.912743] ? __pfx_worker_thread+0x10/0x10 <4> [581.912746] kthread+0x11f/0x250 <4> [581.912755] ? __pfx_kthread+0x10/0x10 <4> [581.912760] ret_from_fork+0x344/0x3a0 <4> [581.912763] ? __pfx_kthread+0x10/0x10 <4> [581.912768] ret_from_fork_asm+0x1a/0x30 <4> [581.912780] </TASK> <4> [581.912781] irq event stamp: 1059757 <4> [581.912783] hardirqs last enabled at (1059763): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.912787] hardirqs last disabled at (1059768): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.912789] softirqs last enabled at (1059690): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.912793] softirqs last disabled at (1059685): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.912796] ---[ end trace 0000000000000000 ]--- <7> [581.912762] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [581.912799] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.912912] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [581.912924] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=16, flags=0x0 in xe_compute_pree [8005] <7> [581.912930] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [581.913039] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.913101] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.914147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.914279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.914413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.914538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.914657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.914803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.914940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.915072] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.915210] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.915388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.916856] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [581.926783] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [581.927086] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [581.928502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [581.928580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [581.928654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [581.929083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [581.929210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [581.929320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [581.929507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [581.929627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [581.929753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [581.929869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [581.929990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [581.930115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [581.930232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [581.930350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [581.930468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [581.930586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [581.930702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [581.930845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [581.930964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [581.931079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [581.931196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [581.931313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [581.931429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [581.931539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [581.931648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [581.931779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [581.931900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [581.932017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [581.932129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [581.932243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [581.932357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [581.932475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [581.932591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [581.932715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [581.932806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [581.932888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [581.932964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [581.933040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [581.933116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [581.933197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [581.933274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [581.933351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [581.933425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [581.933502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [581.933575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [581.933653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [581.933735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [581.933812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [581.933881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [581.933949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [581.934020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [581.934088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [581.934156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [581.934226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [581.934301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [581.934375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [581.934452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [581.934533] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [581.935816] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [581.936663] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20152, lrc_seqno=20152, guc_id=0, flags=0x73 in no process [-1] <7> [581.936667] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.936738] ------------[ cut here ]------------ <4> [581.936739] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.936741] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#1: kworker/u64:30/6373 <4> [581.936811] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.936874] efi_pstore nfnetlink autofs4 <4> [581.936879] CPU: 1 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.936882] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.936883] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.936884] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.936889] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.936957] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.936958] RSP: 0000:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [581.936961] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.936962] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.936963] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.936964] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea18340 <4> [581.936965] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.936966] FS: 0000000000000000(0000) GS:ffff8888dad5d000(0000) knlGS:0000000000000000 <4> [581.936968] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.936969] CR2: 00007023f2b85000 CR3: 000000012f9c1001 CR4: 0000000000f72ef0 <4> [581.936970] PKRU: 55555554 <4> [581.936971] Call Trace: <4> [581.936972] <TASK> <4> [581.936976] ? lock_acquire+0xc4/0x2c0 <4> [581.936981] ? find_held_lock+0x31/0x90 <4> [581.936984] ? lock_release+0xce/0x280 <4> [581.936989] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.936994] process_one_work+0x22e/0x6b0 <4> [581.937001] worker_thread+0x1e8/0x3d0 <4> [581.937003] ? __pfx_worker_thread+0x10/0x10 <4> [581.937005] kthread+0x11f/0x250 <4> [581.937009] ? __pfx_kthread+0x10/0x10 <4> [581.937012] ret_from_fork+0x344/0x3a0 <4> [581.937014] ? __pfx_kthread+0x10/0x10 <4> [581.937017] ret_from_fork_asm+0x1a/0x30 <4> [581.937026] </TASK> <4> [581.937027] irq event stamp: 221393 <4> [581.937028] hardirqs last enabled at (221399): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.937030] hardirqs last disabled at (221404): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.937032] softirqs last enabled at (217966): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.937034] softirqs last disabled at (217959): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.937036] ---[ end trace 0000000000000000 ]--- <7> [581.940838] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [581.940968] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [581.941879] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20222, lrc_seqno=20222, guc_id=0, flags=0x73 in no process [-1] <7> [581.941886] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.941984] ------------[ cut here ]------------ <4> [581.941986] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.941989] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#3: kworker/u64:37/6381 <4> [581.942094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.942202] efi_pstore nfnetlink autofs4 <4> [581.942209] CPU: 3 UID: 0 PID: 6381 Comm: kworker/u64:37 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.942213] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.942215] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.942217] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.942225] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.942330] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.942332] RSP: 0018:ffffc9000ab87ca0 EFLAGS: 00010246 <4> [581.942336] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.942338] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.942340] RBP: ffffc9000ab87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.942342] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667d440 <4> [581.942344] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.942346] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [581.942348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.942350] CR2: 00006183e94a0098 CR3: 000000012fb3a006 CR4: 0000000000f72ef0 <4> [581.942352] PKRU: 55555554 <4> [581.942354] Call Trace: <4> [581.942355] <TASK> <4> [581.942362] ? lock_acquire+0xc4/0x2c0 <4> [581.942367] ? find_held_lock+0x31/0x90 <4> [581.942373] ? lock_release+0xce/0x280 <4> [581.942380] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.942389] process_one_work+0x22e/0x6b0 <4> [581.942400] worker_thread+0x1e8/0x3d0 <4> [581.942404] ? __pfx_worker_thread+0x10/0x10 <4> [581.942407] kthread+0x11f/0x250 <4> [581.942412] ? __pfx_kthread+0x10/0x10 <4> [581.942418] ret_from_fork+0x344/0x3a0 <4> [581.942421] ? __pfx_kthread+0x10/0x10 <4> [581.942426] ret_from_fork_asm+0x1a/0x30 <4> [581.942440] </TASK> <4> [581.942442] irq event stamp: 212313 <4> [581.942444] hardirqs last enabled at (212319): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.942448] hardirqs last disabled at (212324): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.942451] softirqs last enabled at (211188): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.942455] softirqs last disabled at (211183): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.942458] ---[ end trace 0000000000000000 ]--- <6> [581.942461] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.942566] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [581.942577] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.942609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.943447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.943549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.943648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.943757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.943853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.943938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.944020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.944111] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.944208] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.944331] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.945408] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [581.955732] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [581.956002] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [581.957191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [581.957269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [581.957343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [581.957423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [581.957499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [581.957574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [581.957650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [581.957732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [581.957806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [581.957888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [581.957964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [581.958039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [581.958115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [581.958191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [581.958266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [581.958342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [581.958418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [581.958497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [581.958572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [581.958655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [581.958740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [581.958818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [581.958896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [581.958971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [581.959046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [581.959123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [581.959202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [581.959287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [581.959364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [581.959442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [581.959520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [581.959610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [581.959691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [581.959790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [581.959869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [581.959945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [581.960018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [581.960091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [581.960167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [581.960247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [581.960322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [581.960397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [581.960470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [581.960547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [581.960622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [581.960700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [581.960796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [581.960875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [581.960950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [581.961024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [581.961101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [581.961175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [581.961250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [581.961325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [581.961404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [581.961480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [581.961554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [581.961631] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [581.962963] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [581.963815] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20222, lrc_seqno=20222, guc_id=0, flags=0x73 in no process [-1] <7> [581.963824] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.963929] ------------[ cut here ]------------ <4> [581.963931] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.963932] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:37/6381 <4> [581.964003] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux <7> [581.964019] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [581.964086] mei_me <4> [581.964087] intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [581.964116] CPU: 2 UID: 0 PID: 6381 Comm: kworker/u64:37 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.964120] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.964121] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.964123] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.964131] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <7> [581.964161] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [581.964242] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.964244] RSP: 0018:ffffc9000ab87ca0 EFLAGS: 00010246 <4> [581.964247] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.964249] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.964251] RBP: ffffc9000ab87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.964252] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667d440 <4> [581.964254] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.964255] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [581.964257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.964259] CR2: 00007023f2b75000 CR3: 00000001531e8004 CR4: 0000000000f72ef0 <4> [581.964260] PKRU: 55555554 <4> [581.964262] Call Trace: <4> [581.964263] <TASK> <4> [581.964268] ? lock_acquire+0xc4/0x2c0 <4> [581.964273] ? find_held_lock+0x31/0x90 <4> [581.964279] ? lock_release+0xce/0x280 <4> [581.964287] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.964296] process_one_work+0x22e/0x6b0 <4> [581.964307] worker_thread+0x1e8/0x3d0 <4> [581.964312] ? __pfx_worker_thread+0x10/0x10 <4> [581.964314] kthread+0x11f/0x250 <4> [581.964318] ? __pfx_kthread+0x10/0x10 <4> [581.964321] ret_from_fork+0x344/0x3a0 <4> [581.964324] ? __pfx_kthread+0x10/0x10 <4> [581.964326] ret_from_fork_asm+0x1a/0x30 <4> [581.964334] </TASK> <4> [581.964335] irq event stamp: 222989 <4> [581.964336] hardirqs last enabled at (222995): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.964339] hardirqs last disabled at (223000): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.964341] softirqs last enabled at (219728): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.964344] softirqs last disabled at (219723): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.964346] ---[ end trace 0000000000000000 ]--- <6> [581.964348] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.964420] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [581.964428] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=36, flags=0x0 in xe_compute_pree [8005] <7> [581.964431] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [581.964515] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=48, flags=0x0 in xe_compute_pree [8005] <7> [581.964517] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [581.964596] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.964665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.965324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.965417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.965519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.965616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.965702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.965804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.965887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.965977] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.966074] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.966197] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.967252] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [581.977748] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [581.978132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [581.979424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [581.979501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [581.979574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [581.979649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [581.979722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [581.979811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [581.979884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [581.979957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [581.980032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [581.980106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [581.980179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [581.980251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [581.980322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [581.980393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [581.980464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [581.980535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [581.980606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [581.980677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [581.980751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [581.980831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [581.980913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [581.980990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [581.981068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [581.981141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [581.981215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [581.981291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [581.981371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [581.981446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [581.981523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [581.981603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [581.981681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [581.981769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [581.981851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [581.981933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [581.982010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [581.982086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [581.982161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [581.982236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [581.982308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [581.982387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [581.982464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [581.982538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [581.982615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [581.982696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [581.982788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [581.982863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [581.982936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [581.983010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [581.983083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [581.983155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [581.983234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [581.983310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [581.983385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [581.983460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [581.983535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [581.983608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [581.983679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [581.983761] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [581.985334] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [581.986140] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20222, lrc_seqno=20222, guc_id=0, flags=0x73 in no process [-1] <7> [581.986143] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.986209] ------------[ cut here ]------------ <4> [581.986210] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.986212] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:38/6382 <4> [581.986284] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.986348] efi_pstore nfnetlink autofs4 <4> [581.986353] CPU: 8 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.986356] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.986357] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.986358] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.986363] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.986432] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.986433] RSP: 0000:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [581.986435] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.986437] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.986438] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.986439] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667d440 <4> [581.986440] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.986441] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [581.986443] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.986444] CR2: 00007023f0695000 CR3: 0000000115a94005 CR4: 0000000000f72ef0 <4> [581.986445] PKRU: 55555554 <4> [581.986446] Call Trace: <4> [581.986447] <TASK> <4> [581.986451] ? lock_acquire+0xc4/0x2c0 <4> [581.986455] ? find_held_lock+0x31/0x90 <4> [581.986459] ? lock_release+0xce/0x280 <4> [581.986464] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.986469] process_one_work+0x22e/0x6b0 <4> [581.986475] worker_thread+0x1e8/0x3d0 <4> [581.986478] ? __pfx_worker_thread+0x10/0x10 <4> [581.986480] kthread+0x11f/0x250 <4> [581.986483] ? __pfx_kthread+0x10/0x10 <4> [581.986486] ret_from_fork+0x344/0x3a0 <4> [581.986489] ? __pfx_kthread+0x10/0x10 <4> [581.986491] ret_from_fork_asm+0x1a/0x30 <4> [581.986499] </TASK> <4> [581.986500] irq event stamp: 320679 <4> [581.986501] hardirqs last enabled at (320685): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.986504] hardirqs last disabled at (320690): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.986506] softirqs last enabled at (317492): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.986509] softirqs last disabled at (317485): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.986511] ---[ end trace 0000000000000000 ]--- <7> [581.991211] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [581.991461] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [581.992816] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20292, lrc_seqno=20292, guc_id=0, flags=0x73 in no process [-1] <7> [581.992822] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [581.992922] ------------[ cut here ]------------ <4> [581.992924] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [581.992926] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:38/6382 <4> [581.993044] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [581.993145] efi_pstore nfnetlink autofs4 <4> [581.993153] CPU: 8 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [581.993157] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [581.993159] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [581.993161] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [581.993169] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [581.993283] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [581.993285] RSP: 0000:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [581.993289] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [581.993291] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [581.993293] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [581.993295] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1b340 <4> [581.993297] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [581.993299] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [581.993301] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [581.993303] CR2: 00007023f0695000 CR3: 0000000115a94005 CR4: 0000000000f72ef0 <4> [581.993305] PKRU: 55555554 <4> [581.993307] Call Trace: <4> [581.993308] <TASK> <4> [581.993315] ? lock_acquire+0xc4/0x2c0 <4> [581.993322] ? find_held_lock+0x31/0x90 <4> [581.993327] ? lock_release+0xce/0x280 <4> [581.993335] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [581.993344] process_one_work+0x22e/0x6b0 <4> [581.993354] worker_thread+0x1e8/0x3d0 <4> [581.993358] ? __pfx_worker_thread+0x10/0x10 <4> [581.993362] kthread+0x11f/0x250 <4> [581.993367] ? __pfx_kthread+0x10/0x10 <4> [581.993372] ret_from_fork+0x344/0x3a0 <4> [581.993376] ? __pfx_kthread+0x10/0x10 <4> [581.993380] ret_from_fork_asm+0x1a/0x30 <4> [581.993393] </TASK> <4> [581.993394] irq event stamp: 324533 <4> [581.993396] hardirqs last enabled at (324539): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [581.993400] hardirqs last disabled at (324544): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [581.993403] softirqs last enabled at (321652): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.993408] softirqs last disabled at (321643): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [581.993411] ---[ end trace 0000000000000000 ]--- <6> [581.993414] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [581.993527] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [581.993538] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [581.993556] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [581.994661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [581.994758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [581.994857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [581.994943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [581.995037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [581.995131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [581.995220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [581.995303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [581.995398] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [581.995519] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [581.996595] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.006758] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.007036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.008392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.008472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.008548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.008623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.008697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.008815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.008898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.008970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.009046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.009127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.009202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.009278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.009358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.009434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.009510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.009585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.009661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.009737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.009836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.009916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.009995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.010072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.010152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.010226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.010300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.010378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.010458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.010545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.010624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.010701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.010801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.010912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.010994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.011075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.011161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.011242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.011321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.011399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.011474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.011551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.011627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.011705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.011791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.011870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.011945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.012020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.012094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.012171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.012249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.012325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.012404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.012479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.012555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.012629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.012704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.012786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.012864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.012946] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.014527] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.014788] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20292, lrc_seqno=20292, guc_id=0, flags=0x73 in no process [-1] <7> [582.014796] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.015151] ------------[ cut here ]------------ <4> [582.015153] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.015155] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#11: kworker/u64:38/6382 <4> [582.015476] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.015545] efi_pstore nfnetlink autofs4 <4> [582.015551] CPU: 11 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.015555] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.015560] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.015569] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.015574] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <7> [582.015598] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.015681] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.015683] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.015686] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.015688] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.015690] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.015691] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1b340 <4> [582.015693] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.015694] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [582.015696] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.015698] CR2: 00007023f2b75000 CR3: 0000000003448004 CR4: 0000000000f72ef0 <4> [582.015699] PKRU: 55555554 <4> [582.015701] Call Trace: <4> [582.015702] <TASK> <4> [582.015709] ? lock_acquire+0xc4/0x2c0 <4> [582.015714] ? find_held_lock+0x31/0x90 <4> [582.015719] ? lock_release+0xce/0x280 <4> [582.015728] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.015738] process_one_work+0x22e/0x6b0 <4> [582.015760] worker_thread+0x1e8/0x3d0 <4> [582.015764] ? __pfx_worker_thread+0x10/0x10 <4> [582.015767] kthread+0x11f/0x250 <4> [582.015772] ? __pfx_kthread+0x10/0x10 <4> [582.015777] ret_from_fork+0x344/0x3a0 <4> [582.015780] ? __pfx_kthread+0x10/0x10 <4> [582.015783] ret_from_fork_asm+0x1a/0x30 <4> [582.015796] </TASK> <4> [582.015798] irq event stamp: 335281 <4> [582.015799] hardirqs last enabled at (335287): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.015804] hardirqs last disabled at (335292): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.015807] softirqs last enabled at (335232): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.015811] softirqs last disabled at (335225): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.015814] ---[ end trace 0000000000000000 ]--- <7> [582.015746] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [582.015817] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.015927] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [582.015936] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=24, flags=0x0 in xe_compute_pree [8005] <7> [582.015939] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [582.016038] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=57, flags=0x0 in xe_compute_pree [8005] <7> [582.016044] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [582.016198] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=68, flags=0x0 in xe_compute_pree [8005] <7> [582.016200] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [582.016298] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=77, flags=0x0 in xe_compute_pree [8005] <7> [582.016303] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [582.016455] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.016473] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.017720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.017865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.018001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.018133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.018263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.018390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.018520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.018647] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.018790] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.018964] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.020050] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.030775] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.031036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.032495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.032567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.032636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.032703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.032776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.032850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.032923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.032996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.033069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.033146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.033220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.033293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.033365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.033437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.033509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.033580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.033651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.033722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.033807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.033888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.033968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.034046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.034122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.034196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.034271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.034347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.034431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.034512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.034591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.034668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.034746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.034841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.034927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.035011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.035093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.035174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.035251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.035327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.035401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.035477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.035553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.035624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.035698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.035780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.035858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.035935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.036010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.036086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.036160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.036234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.036312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.036390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.036467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.036541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.036616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.036689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.036761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.036849] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.038190] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.038785] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20292, lrc_seqno=20292, guc_id=0, flags=0x73 in no process [-1] <7> [582.038791] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.038892] ------------[ cut here ]------------ <4> [582.038893] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.038895] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#6: kworker/u64:8/204 <4> [582.038969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.039038] efi_pstore nfnetlink autofs4 <4> [582.039042] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.039045] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.039047] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.039048] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.039053] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.039124] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.039126] RSP: 0018:ffffc900014cbca0 EFLAGS: 00010246 <4> [582.039128] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.039129] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.039130] RBP: ffffc900014cbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.039132] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1b340 <4> [582.039133] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.039134] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [582.039135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.039136] CR2: 00007023f2b75000 CR3: 00000001531e8005 CR4: 0000000000f72ef0 <4> [582.039138] PKRU: 55555554 <4> [582.039139] Call Trace: <4> [582.039140] <TASK> <4> [582.039144] ? lock_acquire+0xc4/0x2c0 <4> [582.039148] ? find_held_lock+0x31/0x90 <4> [582.039151] ? lock_release+0xce/0x280 <4> [582.039156] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.039162] process_one_work+0x22e/0x6b0 <4> [582.039168] worker_thread+0x1e8/0x3d0 <4> [582.039171] ? __pfx_worker_thread+0x10/0x10 <4> [582.039173] kthread+0x11f/0x250 <4> [582.039176] ? __pfx_kthread+0x10/0x10 <4> [582.039179] ret_from_fork+0x344/0x3a0 <4> [582.039182] ? __pfx_kthread+0x10/0x10 <4> [582.039184] ret_from_fork_asm+0x1a/0x30 <4> [582.039192] </TASK> <4> [582.039193] irq event stamp: 1993121 <4> [582.039194] hardirqs last enabled at (1993127): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.039197] hardirqs last disabled at (1993132): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.039199] softirqs last enabled at (1989650): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.039201] softirqs last disabled at (1989645): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.039203] ---[ end trace 0000000000000000 ]--- <7> [582.039164] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.039266] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.043983] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=79, flags=0x0 in xe_compute_pree [8005] <7> [582.043989] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [582.044531] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20362, lrc_seqno=20362, guc_id=0, flags=0x73 in no process [-1] <7> [582.044536] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.044599] ------------[ cut here ]------------ <4> [582.044600] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.044602] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#4: kworker/u64:5/201 <4> [582.044679] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.044741] efi_pstore nfnetlink autofs4 <4> [582.044746] CPU: 4 UID: 0 PID: 201 Comm: kworker/u64:5 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.044749] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.044750] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.044751] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.044758] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.044857] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.044859] RSP: 0018:ffffc900014b3ca0 EFLAGS: 00010246 <4> [582.044862] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.044864] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.044865] RBP: ffffc900014b3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.044866] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888176678f40 <4> [582.044867] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.044869] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [582.044870] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.044871] CR2: 00006183e94a2008 CR3: 0000000127e81005 CR4: 0000000000f72ef0 <4> [582.044873] PKRU: 55555554 <4> [582.044874] Call Trace: <4> [582.044875] <TASK> <4> [582.044878] ? lock_acquire+0xc4/0x2c0 <4> [582.044882] ? find_held_lock+0x31/0x90 <4> [582.044885] ? lock_release+0xce/0x280 <4> [582.044890] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.044896] process_one_work+0x22e/0x6b0 <4> [582.044903] worker_thread+0x1e8/0x3d0 <4> [582.044906] ? __pfx_worker_thread+0x10/0x10 <4> [582.044908] kthread+0x11f/0x250 <4> [582.044911] ? __pfx_kthread+0x10/0x10 <4> [582.044914] ret_from_fork+0x344/0x3a0 <4> [582.044917] ? __pfx_kthread+0x10/0x10 <4> [582.044920] ret_from_fork_asm+0x1a/0x30 <4> [582.044927] </TASK> <4> [582.044928] irq event stamp: 1070457 <4> [582.044930] hardirqs last enabled at (1070463): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.044933] hardirqs last disabled at (1070468): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.044935] softirqs last enabled at (1070290): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.044939] softirqs last disabled at (1070277): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.044941] ---[ end trace 0000000000000000 ]--- <6> [582.044943] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.045016] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.045025] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.045061] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.045971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.046086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.046196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.046303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.046431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.046545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.046653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.046733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.046844] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.046983] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.048241] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.058786] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.059087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.061590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.061725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.061851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.061992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.062142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.062318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.062496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.062704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.062848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.063272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.063500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.063783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.064793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.064920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.065191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.065324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.065520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.065655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.065787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.065910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.066033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.066153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.066275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.066394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.066513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.066636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.066792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.066938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.067081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.067449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.067619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.067833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.068008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.068488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.068791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.068916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.069037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.069158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.069278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.069402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.069523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.069644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.069763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.069893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.070014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.070134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.070253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.070375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.070494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.070612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.070735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.070859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.070980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.071098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.071220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.071338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.071456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.071580] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.073346] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.073812] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20362, lrc_seqno=20362, guc_id=0, flags=0x73 in no process [-1] <7> [582.073823] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.074295] ------------[ cut here ]------------ <4> [582.074297] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.074301] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#11: kworker/u64:8/204 <4> [582.074538] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.074613] efi_pstore nfnetlink autofs4 <4> [582.074624] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.074634] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.074636] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.074638] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.074646] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <7> [582.074655] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.074762] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.074765] RSP: 0018:ffffc900014cbca0 EFLAGS: 00010246 <4> [582.074768] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.074770] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.074772] RBP: ffffc900014cbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.074774] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888176678f40 <4> [582.074775] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.074777] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [582.074779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.074790] CR2: 00006183e94a2008 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [582.074792] PKRU: 55555554 <4> [582.074794] Call Trace: <4> [582.074796] <TASK> <4> [582.074802] ? lock_acquire+0xc4/0x2c0 <4> [582.074812] ? find_held_lock+0x31/0x90 <4> [582.074817] ? lock_release+0xce/0x280 <4> [582.074826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.074836] process_one_work+0x22e/0x6b0 <4> [582.074846] worker_thread+0x1e8/0x3d0 <4> [582.074850] ? __pfx_worker_thread+0x10/0x10 <4> [582.074853] kthread+0x11f/0x250 <4> [582.074858] ? __pfx_kthread+0x10/0x10 <4> [582.074862] ret_from_fork+0x344/0x3a0 <4> [582.074865] ? __pfx_kthread+0x10/0x10 <4> [582.074869] ret_from_fork_asm+0x1a/0x30 <4> [582.074883] </TASK> <4> [582.074884] irq event stamp: 2005677 <4> [582.074886] hardirqs last enabled at (2005683): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.074890] hardirqs last disabled at (2005688): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.074893] softirqs last enabled at (2005574): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.074897] softirqs last disabled at (2005567): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.074901] ---[ end trace 0000000000000000 ]--- <7> [582.074835] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [582.074904] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.075005] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [582.075016] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=52, flags=0x0 in xe_compute_pree [8005] <7> [582.075020] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [582.075142] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.075193] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.075891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.075985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.076079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.076175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.076261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.076360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.076460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.076541] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.076636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.076817] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.078145] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.088908] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.089233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.091140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.091222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.091298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.091372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.091445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.091581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.091654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.091753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.091903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.092140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.092277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.092488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.092797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.093118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.093258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.093331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.093476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.093547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.093655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.093734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.093820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.093898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.093978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.094057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.094133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.094212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.094298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.094535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.094700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.094778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.094875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.094973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.095087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.095184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.095262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.095340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.095414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.095488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.095561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.095640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.095720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.095804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.095880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.095952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.096020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.096088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.096158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.096230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.096298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.096367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.096438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.096507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.096575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.096642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.096710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.096778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.096868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.096944] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.098120] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.098975] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20362, lrc_seqno=20362, guc_id=0, flags=0x73 in no process [-1] <7> [582.098978] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.099059] ------------[ cut here ]------------ <4> [582.099061] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.099063] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#11: kworker/u64:8/204 <4> [582.099137] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.099194] efi_pstore nfnetlink autofs4 <4> [582.099199] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.099201] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.099202] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.099203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.099208] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.099270] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.099271] RSP: 0018:ffffc900014cbca0 EFLAGS: 00010246 <4> [582.099273] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.099274] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.099276] RBP: ffffc900014cbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.099277] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888176678f40 <4> [582.099278] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.099279] FS: 0000000000000000(0000) GS:ffff8888db25d000(0000) knlGS:0000000000000000 <4> [582.099280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.099281] CR2: 00006183e94a2008 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [582.099282] PKRU: 55555554 <4> [582.099283] Call Trace: <4> [582.099284] <TASK> <4> [582.099288] ? lock_acquire+0xc4/0x2c0 <4> [582.099292] ? find_held_lock+0x31/0x90 <4> [582.099295] ? lock_release+0xce/0x280 <4> [582.099299] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.099304] process_one_work+0x22e/0x6b0 <4> [582.099309] worker_thread+0x1e8/0x3d0 <4> [582.099312] ? __pfx_worker_thread+0x10/0x10 <4> [582.099314] kthread+0x11f/0x250 <4> [582.099316] ? __pfx_kthread+0x10/0x10 <4> [582.099319] ret_from_fork+0x344/0x3a0 <4> [582.099322] ? __pfx_kthread+0x10/0x10 <4> [582.099324] ret_from_fork_asm+0x1a/0x30 <4> [582.099331] </TASK> <4> [582.099332] irq event stamp: 2016353 <4> [582.099333] hardirqs last enabled at (2016359): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.099335] hardirqs last disabled at (2016364): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.099337] softirqs last enabled at (2014928): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.099340] softirqs last disabled at (2014921): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.099341] ---[ end trace 0000000000000000 ]--- <7> [582.100918] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.101052] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.102165] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20419, lrc_seqno=20419, guc_id=0, flags=0x73 in no process [-1] <7> [582.102173] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.102286] ------------[ cut here ]------------ <4> [582.102288] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.102290] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#15: kworker/u64:37/6381 <4> [582.102409] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.102498] efi_pstore nfnetlink autofs4 <4> [582.102505] CPU: 15 UID: 0 PID: 6381 Comm: kworker/u64:37 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.102509] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.102510] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.102512] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.102520] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.102633] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.102635] RSP: 0018:ffffc9000ab87ca0 EFLAGS: 00010246 <4> [582.102638] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.102640] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.102641] RBP: ffffc9000ab87da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.102643] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea19840 <4> [582.102645] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.102647] FS: 0000000000000000(0000) GS:ffff8888db45d000(0000) knlGS:0000000000000000 <4> [582.102649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.102651] CR2: 00007023f2b75000 CR3: 0000000165389001 CR4: 0000000000f72ef0 <4> [582.102652] PKRU: 55555554 <4> [582.102654] Call Trace: <4> [582.102655] <TASK> <4> [582.102662] ? lock_acquire+0xc4/0x2c0 <4> [582.102667] ? find_held_lock+0x31/0x90 <4> [582.102672] ? lock_release+0xce/0x280 <4> [582.102680] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.102689] process_one_work+0x22e/0x6b0 <4> [582.102699] worker_thread+0x1e8/0x3d0 <4> [582.102703] ? __pfx_worker_thread+0x10/0x10 <4> [582.102706] kthread+0x11f/0x250 <4> [582.102710] ? __pfx_kthread+0x10/0x10 <4> [582.102715] ret_from_fork+0x344/0x3a0 <4> [582.102718] ? __pfx_kthread+0x10/0x10 <4> [582.102722] ret_from_fork_asm+0x1a/0x30 <4> [582.102734] </TASK> <4> [582.102736] irq event stamp: 229639 <4> [582.102737] hardirqs last enabled at (229645): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.102741] hardirqs last disabled at (229650): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.102744] softirqs last enabled at (227532): [<ffffffff81334683>] kernel_fpu_end+0x53/0x70 <4> [582.102747] softirqs last disabled at (227530): [<ffffffff81334d34>] kernel_fpu_begin_mask+0xc4/0x120 <4> [582.102750] ---[ end trace 0000000000000000 ]--- <6> [582.102752] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.102878] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.102891] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.102949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.104519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.104652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.104786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.104943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.105067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.105184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.105305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.105427] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.105560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.105721] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.106922] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.116863] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.117135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.118558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.118637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.118711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.118785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.118890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.119000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.119110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.119220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.119326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.119435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.119540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.119646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.119751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.119880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.119985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.120090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.120198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.120308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.120413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.120531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.120647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.120758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.120891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.121002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.121114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.121231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.121351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.121466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.121578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.121694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.121812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.121932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.122052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.122171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.122293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.122410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.122521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.122631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.122742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.122877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.122992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.123105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.123215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.123331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.123445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.123578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.123689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.123803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.123945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.124060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.124174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.124290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.124405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.124516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.124627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.124737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.124862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.124979] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.126624] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.127503] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20419, lrc_seqno=20419, guc_id=0, flags=0x73 in no process [-1] <7> [582.127525] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.127600] ------------[ cut here ]------------ <4> [582.127601] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.127602] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#5: kworker/u64:33/6376 <4> [582.127677] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.127742] efi_pstore nfnetlink autofs4 <4> [582.127748] CPU: 5 UID: 0 PID: 6376 Comm: kworker/u64:33 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.127762] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.127764] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.127766] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.127774] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.127883] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.127885] RSP: 0018:ffffc9000a1e3ca0 EFLAGS: 00010246 <4> [582.127889] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.127892] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.127894] RBP: ffffc9000a1e3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.127896] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea19840 <4> [582.127898] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.127900] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [582.127902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.127903] CR2: 00007023ec50d000 CR3: 0000000176655006 CR4: 0000000000f72ef0 <4> [582.127911] PKRU: 55555554 <4> [582.127913] Call Trace: <4> [582.127915] <TASK> <4> [582.127922] ? lock_acquire+0xc4/0x2c0 <4> [582.127928] ? find_held_lock+0x31/0x90 <4> [582.127933] ? lock_release+0xce/0x280 <4> [582.127941] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.127950] process_one_work+0x22e/0x6b0 <4> [582.127961] worker_thread+0x1e8/0x3d0 <4> [582.127965] ? __pfx_worker_thread+0x10/0x10 <4> [582.127969] kthread+0x11f/0x250 <4> [582.127974] ? __pfx_kthread+0x10/0x10 <4> [582.127980] ret_from_fork+0x344/0x3a0 <4> [582.127983] ? __pfx_kthread+0x10/0x10 <4> [582.127988] ret_from_fork_asm+0x1a/0x30 <4> [582.128001] </TASK> <4> [582.128003] irq event stamp: 44567 <4> [582.128005] hardirqs last enabled at (44573): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.128009] hardirqs last disabled at (44578): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.128012] softirqs last enabled at (44400): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.128016] softirqs last disabled at (44393): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.128019] ---[ end trace 0000000000000000 ]--- <6> [582.128022] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.128134] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.128157] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.128279] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.128382] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.128943] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.129522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.129611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.129701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.129786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.129887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.129974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.130058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.130140] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.130232] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.130345] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.131358] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.141824] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.142085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.143310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.143385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.143459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.143534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.143607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.143679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.143750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.143828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.143898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.143966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.144038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.144111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.144184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.144255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.144327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.144401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.144473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.144548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.144622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.144702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.144781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.144869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.144947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.145021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.145096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.145178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.145261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.145340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.145418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.145494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.145571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.145652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.145732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.145813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.145907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.145984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.146062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.146140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.146217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.146295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.146371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.146445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.146519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.146600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.146677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.146752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.146830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.146904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.146976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.147047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.147122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.147195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.147268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.147341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.147414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.147485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.147557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.147636] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.148757] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.149610] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20419, lrc_seqno=20419, guc_id=0, flags=0x73 in no process [-1] <7> [582.149614] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.149678] ------------[ cut here ]------------ <4> [582.149679] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.149680] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#4: kworker/u64:33/6376 <4> [582.149751] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.149816] efi_pstore nfnetlink autofs4 <4> [582.149826] CPU: 4 UID: 0 PID: 6376 Comm: kworker/u64:33 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.149829] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.149831] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.149832] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.149837] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.149906] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.149908] RSP: 0018:ffffc9000a1e3ca0 EFLAGS: 00010246 <4> [582.149910] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.149911] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.149913] RBP: ffffc9000a1e3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.149914] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea19840 <4> [582.149915] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.149916] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [582.149917] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.149919] CR2: 00007023ec50d000 CR3: 00000001375fd002 CR4: 0000000000f72ef0 <4> [582.149920] PKRU: 55555554 <4> [582.149921] Call Trace: <4> [582.149922] <TASK> <4> [582.149926] ? lock_acquire+0xc4/0x2c0 <4> [582.149930] ? find_held_lock+0x31/0x90 <4> [582.149933] ? lock_release+0xce/0x280 <4> [582.149938] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.149943] process_one_work+0x22e/0x6b0 <4> [582.149950] worker_thread+0x1e8/0x3d0 <4> [582.149952] ? __pfx_worker_thread+0x10/0x10 <4> [582.149954] kthread+0x11f/0x250 <4> [582.149958] ? __pfx_kthread+0x10/0x10 <4> [582.149961] ret_from_fork+0x344/0x3a0 <4> [582.149963] ? __pfx_kthread+0x10/0x10 <4> [582.149966] ret_from_fork_asm+0x1a/0x30 <4> [582.149974] </TASK> <4> [582.149975] irq event stamp: 55199 <4> [582.149976] hardirqs last enabled at (55205): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.149979] hardirqs last disabled at (55210): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.149981] softirqs last enabled at (51750): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.149984] softirqs last disabled at (51745): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.149986] ---[ end trace 0000000000000000 ]--- <7> [582.155175] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.155311] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.156576] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20489, lrc_seqno=20489, guc_id=0, flags=0x73 in no process [-1] <7> [582.156582] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.156678] ------------[ cut here ]------------ <4> [582.156680] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.156683] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#0: kworker/u64:19/2428 <4> [582.156791] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.156918] efi_pstore nfnetlink autofs4 <4> [582.156926] CPU: 0 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.156930] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.156932] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.156934] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.156943] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.157046] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.157049] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.157053] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.157056] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.157058] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.157060] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667ec40 <4> [582.157062] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.157064] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [582.157067] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.157069] CR2: 00007023f2a75000 CR3: 000000023008e003 CR4: 0000000000f72ef0 <4> [582.157071] PKRU: 55555554 <4> [582.157073] Call Trace: <4> [582.157075] <TASK> <4> [582.157082] ? lock_acquire+0xc4/0x2c0 <4> [582.157089] ? find_held_lock+0x31/0x90 <4> [582.157095] ? lock_release+0xce/0x280 <4> [582.157103] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.157113] process_one_work+0x22e/0x6b0 <4> [582.157124] worker_thread+0x1e8/0x3d0 <4> [582.157129] ? __pfx_worker_thread+0x10/0x10 <4> [582.157133] kthread+0x11f/0x250 <4> [582.157138] ? __pfx_kthread+0x10/0x10 <4> [582.157144] ret_from_fork+0x344/0x3a0 <4> [582.157147] ? __pfx_kthread+0x10/0x10 <4> [582.157152] ret_from_fork_asm+0x1a/0x30 <4> [582.157166] </TASK> <4> [582.157168] irq event stamp: 607115 <4> [582.157170] hardirqs last enabled at (607121): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.157174] hardirqs last disabled at (607126): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.157177] softirqs last enabled at (606498): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.157181] softirqs last disabled at (606493): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.157185] ---[ end trace 0000000000000000 ]--- <6> [582.157188] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.157291] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.157300] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.157319] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.158434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.158559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.158700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.158842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.158963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.159096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.159233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.159361] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.159498] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.159674] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.161003] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.170889] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.171180] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.172533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.172613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.172688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.172765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.172849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.173001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.173123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.173234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.173344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.173453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.173575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.173697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.173820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.173964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.174078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.174204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.174329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.174438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.174563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.174677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.174794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.174928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.175043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.175154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.175264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.175377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.175495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.175616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.175740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.175872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.175994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.176116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.176262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.176420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.176546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.176661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.176774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.176908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.177020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.177138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.177252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.177363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.177472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.177587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.177701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.177816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.177954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.178068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.178179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.178290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.178409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.178521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.178632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.178745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.178862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.178973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.179085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.179201] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.180568] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.180854] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20489, lrc_seqno=20489, guc_id=0, flags=0x73 in no process [-1] <7> [582.180863] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.181258] ------------[ cut here ]------------ <4> [582.181261] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.181263] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:19/2428 <4> [582.181603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.181677] efi_pstore nfnetlink autofs4 <4> [582.181682] CPU: 9 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.181685] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.181686] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.181687] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.181693] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.181798] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.181801] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.181805] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.181807] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.181809] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.181811] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667ec40 <4> [582.181813] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.181815] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <7> [582.181742] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.181817] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.181819] CR2: 00007023ec40d000 CR3: 0000000003448003 CR4: 0000000000f72ef0 <4> [582.181821] PKRU: 55555554 <4> [582.181823] Call Trace: <4> [582.181824] <TASK> <4> [582.181830] ? lock_acquire+0xc4/0x2c0 <4> [582.181841] ? find_held_lock+0x31/0x90 <4> [582.181846] ? lock_release+0xce/0x280 <4> [582.181853] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.181862] process_one_work+0x22e/0x6b0 <4> [582.181873] worker_thread+0x1e8/0x3d0 <4> [582.181877] ? __pfx_worker_thread+0x10/0x10 <4> [582.181880] kthread+0x11f/0x250 <4> [582.181885] ? __pfx_kthread+0x10/0x10 <4> [582.181890] ret_from_fork+0x344/0x3a0 <4> [582.181898] ? __pfx_kthread+0x10/0x10 <4> [582.181902] ret_from_fork_asm+0x1a/0x30 <4> [582.181915] </TASK> <4> [582.181916] irq event stamp: 617823 <4> [582.181918] hardirqs last enabled at (617829): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.181922] hardirqs last disabled at (617834): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.181924] softirqs last enabled at (615670): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.181928] softirqs last disabled at (615627): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.181931] ---[ end trace 0000000000000000 ]--- <7> [582.181905] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [582.181933] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.182046] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [582.182059] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=61, flags=0x0 in xe_compute_pree [8005] <7> [582.182061] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [582.182158] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=70, flags=0x0 in xe_compute_pree [8005] <7> [582.182165] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [582.182302] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.182359] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.183240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.183374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.183518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.183649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.183788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.183927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.184058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.184186] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.184329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.184505] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.186715] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.197496] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.197817] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.199311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.199427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.199541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.199656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.199772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.199895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.200011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.200127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.200242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.200357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.200471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.200586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.200701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.200816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.200936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.201051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.201166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.201281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.201396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.201516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.201636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.201755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.201879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.201997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.202116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.202237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.202362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.202484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.202604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.202725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.202852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.202981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.203107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.203234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.203358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.203481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.203601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.203721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.203839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.203967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.204088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.204208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.204327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.204450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.204570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.204689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.204808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.204933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.205051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.205169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.205292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.205412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.205532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.205651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.205771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.205893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.206011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.206133] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.207496] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.208789] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20489, lrc_seqno=20489, guc_id=0, flags=0x73 in no process [-1] <7> [582.208794] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.208907] ------------[ cut here ]------------ <4> [582.208909] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.208911] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#12: kworker/u64:19/2428 <4> [582.209019] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.209109] efi_pstore nfnetlink autofs4 <4> [582.209115] CPU: 12 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.209119] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.209120] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.209122] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.209129] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.209236] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.209239] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.209242] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.209244] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.209245] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.209247] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667ec40 <4> [582.209248] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.209250] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [582.209252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.209254] CR2: 00007023ec50d000 CR3: 0000000003448002 CR4: 0000000000f72ef0 <4> [582.209256] PKRU: 55555554 <4> [582.209257] Call Trace: <4> [582.209258] <TASK> <4> [582.209265] ? lock_acquire+0xc4/0x2c0 <4> [582.209271] ? find_held_lock+0x31/0x90 <4> [582.209276] ? lock_release+0xce/0x280 <4> [582.209283] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.209292] process_one_work+0x22e/0x6b0 <4> [582.209302] worker_thread+0x1e8/0x3d0 <4> [582.209306] ? __pfx_worker_thread+0x10/0x10 <4> [582.209309] kthread+0x11f/0x250 <4> [582.209313] ? __pfx_kthread+0x10/0x10 <4> [582.209318] ret_from_fork+0x344/0x3a0 <4> [582.209321] ? __pfx_kthread+0x10/0x10 <4> [582.209324] ret_from_fork_asm+0x1a/0x30 <4> [582.209337] </TASK> <4> [582.209338] irq event stamp: 628581 <4> [582.209340] hardirqs last enabled at (628587): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.209343] hardirqs last disabled at (628592): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.209346] softirqs last enabled at (625320): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.209349] softirqs last disabled at (625313): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.209352] ---[ end trace 0000000000000000 ]--- <7> [582.213796] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.214003] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.214756] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20559, lrc_seqno=20559, guc_id=0, flags=0x73 in no process [-1] <7> [582.214764] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.214867] ------------[ cut here ]------------ <4> [582.214869] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.214872] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:28/4669 <4> [582.214983] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.215092] efi_pstore nfnetlink autofs4 <4> [582.215098] CPU: 2 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.215103] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.215105] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.215108] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.215117] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.215223] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.215225] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.215229] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.215232] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.215233] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.215234] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c0940 <4> [582.215236] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.215237] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.215239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.215241] CR2: 00007023ec40d000 CR3: 0000000164e24006 CR4: 0000000000f72ef0 <4> [582.215242] PKRU: 55555554 <4> [582.215244] Call Trace: <4> [582.215246] <TASK> <4> [582.215254] ? lock_acquire+0xc4/0x2c0 <4> [582.215259] ? find_held_lock+0x31/0x90 <4> [582.215263] ? lock_release+0xce/0x280 <4> [582.215272] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.215281] process_one_work+0x22e/0x6b0 <4> [582.215291] worker_thread+0x1e8/0x3d0 <4> [582.215296] ? __pfx_worker_thread+0x10/0x10 <4> [582.215300] kthread+0x11f/0x250 <4> [582.215305] ? __pfx_kthread+0x10/0x10 <4> [582.215309] ret_from_fork+0x344/0x3a0 <4> [582.215313] ? __pfx_kthread+0x10/0x10 <4> [582.215317] ret_from_fork_asm+0x1a/0x30 <4> [582.215330] </TASK> <4> [582.215332] irq event stamp: 398791 <4> [582.215334] hardirqs last enabled at (398797): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.215338] hardirqs last disabled at (398802): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.215340] softirqs last enabled at (396160): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.215344] softirqs last disabled at (396153): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.215347] ---[ end trace 0000000000000000 ]--- <6> [582.215350] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.215442] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.215452] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.215497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.216436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.216562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.216686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.216801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.216939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.217058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.217175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.217287] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.217414] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.217578] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.218876] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.228877] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.229202] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.230881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.230982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.231080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.231190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.231293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.231393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.231506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.231616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.231723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.231819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.231944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.232066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.232181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.232280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.232379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.232477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.232575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.232669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.232769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.232882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.232986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.233088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.233191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.233292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.233390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.233496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.233794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.233908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.234021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.234132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.234242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.234373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.234503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.234649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.234759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.234869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.234972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.235074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.235174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.235280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.235381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.235481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.235582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.235688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.235787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.235891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.235990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.236091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.236189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.236289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.236397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.236498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.236599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.236701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.236804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.236914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.237012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.237115] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.238617] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.239753] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20559, lrc_seqno=20559, guc_id=0, flags=0x73 in no process [-1] <7> [582.239757] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.239841] ------------[ cut here ]------------ <4> [582.239842] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.239844] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:28/4669 <4> [582.239959] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.240053] efi_pstore nfnetlink autofs4 <4> [582.240060] CPU: 2 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.240065] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.240067] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.240069] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.240077] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.240168] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.240170] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.240173] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.240175] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.240176] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.240178] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c0940 <4> [582.240180] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.240183] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.240185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.240187] CR2: 00007023ec40d000 CR3: 0000000164e24006 CR4: 0000000000f72ef0 <4> [582.240190] PKRU: 55555554 <4> [582.240192] Call Trace: <4> [582.240193] <TASK> <4> [582.240200] ? lock_acquire+0xc4/0x2c0 <4> [582.240206] ? find_held_lock+0x31/0x90 <4> [582.240211] ? lock_release+0xce/0x280 <4> [582.240220] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.240229] process_one_work+0x22e/0x6b0 <4> [582.240239] worker_thread+0x1e8/0x3d0 <4> [582.240243] ? __pfx_worker_thread+0x10/0x10 <4> [582.240246] kthread+0x11f/0x250 <4> [582.240251] ? __pfx_kthread+0x10/0x10 <4> [582.240257] ret_from_fork+0x344/0x3a0 <4> [582.240260] ? __pfx_kthread+0x10/0x10 <4> [582.240264] ret_from_fork_asm+0x1a/0x30 <4> [582.240275] </TASK> <4> [582.240277] irq event stamp: 409459 <4> [582.240279] hardirqs last enabled at (409465): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.240284] hardirqs last disabled at (409470): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.240286] softirqs last enabled at (408704): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.240290] softirqs last disabled at (408699): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.240293] ---[ end trace 0000000000000000 ]--- <6> [582.240295] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.240387] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.240396] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.240469] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.240599] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.240738] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.241651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.241766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.241894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.242016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.242127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.242238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.242349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.242455] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.242578] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.242739] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.244040] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.253892] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.254218] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.255727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.255826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.255940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.256039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.256145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.256255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.256361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.256458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.256559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.256664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.256771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.256882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.256980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.257084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.257191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.257299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.257401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.257508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.257615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.257720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.257823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.257947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.258052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.258158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.258263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.258368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.258481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.258584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.258687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.258798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.258913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.259024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.259133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.259249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.259357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.259462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.259564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.259667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.259768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.259870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.259998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.260101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.260202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.260307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.260409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.260508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.260605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.260706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.260806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.260916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.261020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.261112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.261212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.261325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.261425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.261521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.261593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.261664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.262870] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.263730] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20559, lrc_seqno=20559, guc_id=0, flags=0x73 in no process [-1] <7> [582.263734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.263800] ------------[ cut here ]------------ <4> [582.263801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.263803] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:28/4669 <4> [582.263891] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.263954] efi_pstore nfnetlink autofs4 <4> [582.263958] CPU: 8 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.263961] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.263962] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.263964] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.263969] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.264040] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.264042] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.264044] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.264046] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.264047] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.264048] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c0940 <4> [582.264049] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.264050] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [582.264051] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.264053] CR2: 00007023ec50d000 CR3: 00000001375fd005 CR4: 0000000000f72ef0 <4> [582.264054] PKRU: 55555554 <4> [582.264055] Call Trace: <4> [582.264056] <TASK> <4> [582.264060] ? lock_acquire+0xc4/0x2c0 <4> [582.264064] ? find_held_lock+0x31/0x90 <4> [582.264067] ? lock_release+0xce/0x280 <4> [582.264072] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.264078] process_one_work+0x22e/0x6b0 <4> [582.264084] worker_thread+0x1e8/0x3d0 <4> [582.264086] ? __pfx_worker_thread+0x10/0x10 <4> [582.264088] kthread+0x11f/0x250 <4> [582.264092] ? __pfx_kthread+0x10/0x10 <4> [582.264095] ret_from_fork+0x344/0x3a0 <4> [582.264097] ? __pfx_kthread+0x10/0x10 <4> [582.264100] ret_from_fork_asm+0x1a/0x30 <4> [582.264107] </TASK> <4> [582.264108] irq event stamp: 420131 <4> [582.264110] hardirqs last enabled at (420137): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.264112] hardirqs last disabled at (420142): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.264114] softirqs last enabled at (419378): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.264117] softirqs last disabled at (419353): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.264119] ---[ end trace 0000000000000000 ]--- <7> [582.268247] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.268397] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.269093] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20629, lrc_seqno=20629, guc_id=0, flags=0x73 in no process [-1] <7> [582.269097] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.269161] ------------[ cut here ]------------ <4> [582.269162] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.269163] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:28/4669 <4> [582.269234] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.269297] efi_pstore nfnetlink autofs4 <4> [582.269302] CPU: 8 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.269305] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.269306] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.269307] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.269312] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.269380] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.269382] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.269384] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.269385] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.269386] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.269387] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888173fc8640 <4> [582.269389] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.269390] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [582.269391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.269392] CR2: 00007023ec50d000 CR3: 00000001375fd005 CR4: 0000000000f72ef0 <4> [582.269394] PKRU: 55555554 <4> [582.269395] Call Trace: <4> [582.269396] <TASK> <4> [582.269399] ? lock_acquire+0xc4/0x2c0 <4> [582.269403] ? find_held_lock+0x31/0x90 <4> [582.269406] ? lock_release+0xce/0x280 <4> [582.269411] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.269417] process_one_work+0x22e/0x6b0 <4> [582.269423] worker_thread+0x1e8/0x3d0 <4> [582.269425] ? __pfx_worker_thread+0x10/0x10 <4> [582.269427] kthread+0x11f/0x250 <4> [582.269430] ? __pfx_kthread+0x10/0x10 <4> [582.269434] ret_from_fork+0x344/0x3a0 <4> [582.269436] ? __pfx_kthread+0x10/0x10 <4> [582.269439] ret_from_fork_asm+0x1a/0x30 <4> [582.269446] </TASK> <4> [582.269447] irq event stamp: 422155 <4> [582.269448] hardirqs last enabled at (422161): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.269451] hardirqs last disabled at (422166): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.269453] softirqs last enabled at (420204): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.269456] softirqs last disabled at (420199): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.269458] ---[ end trace 0000000000000000 ]--- <6> [582.269460] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.269528] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.269534] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.269591] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.270234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.270324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.270416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.270505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.270598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.270688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.270774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.270857] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.270964] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.271087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.272232] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.282897] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.283191] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.284558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.284635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.284710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.284792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.284886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.285000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.285072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.285143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.285218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.285306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.285378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.285450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.285522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.285595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.285745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.285827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.285918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.286004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.286090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.286169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.286249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.286329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.286407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.286482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.286556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.286633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.286718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.286802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.286896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.286991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.287086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.287177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.287269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.287359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.287448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.287525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.287599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.287672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.287745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.287822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.287902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.287977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.288055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.288135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.288212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.288287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.288362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.288437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.288508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.288580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.288659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.288736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.288812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.288885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.288981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.289054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.289128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.289204] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.290725] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.290918] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20629, lrc_seqno=20629, guc_id=0, flags=0x73 in no process [-1] <7> [582.290926] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.291326] ------------[ cut here ]------------ <4> [582.291328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.291331] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:28/4669 <4> [582.291735] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.291807] efi_pstore nfnetlink autofs4 <4> [582.291812] CPU: 9 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.291814] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.291815] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.291817] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.291822] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.291937] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.291940] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.291945] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.291948] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.291950] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.291952] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888173fc8640 <4> [582.291955] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.291957] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [582.291960] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.291963] CR2: 00007023ec3dd000 CR3: 000000017bb21003 CR4: 0000000000f72ef0 <4> [582.291966] PKRU: 55555554 <4> [582.291968] Call Trace: <7> [582.291872] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.291970] <TASK> <4> [582.291978] ? lock_acquire+0xc4/0x2c0 <4> [582.291983] ? find_held_lock+0x31/0x90 <4> [582.291989] ? lock_release+0xce/0x280 <4> [582.291998] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.292008] process_one_work+0x22e/0x6b0 <4> [582.292019] worker_thread+0x1e8/0x3d0 <4> [582.292023] ? __pfx_worker_thread+0x10/0x10 <4> [582.292026] kthread+0x11f/0x250 <4> [582.292032] ? __pfx_kthread+0x10/0x10 <4> [582.292038] ret_from_fork+0x344/0x3a0 <4> [582.292041] ? __pfx_kthread+0x10/0x10 <4> [582.292046] ret_from_fork_asm+0x1a/0x30 <4> [582.292061] </TASK> <4> [582.292066] irq event stamp: 432839 <4> [582.292068] hardirqs last enabled at (432845): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.292072] hardirqs last disabled at (432850): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.292075] softirqs last enabled at (429624): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.292079] softirqs last disabled at (429619): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.292082] ---[ end trace 0000000000000000 ]--- <6> [582.292084] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [582.292074] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [582.292198] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.292227] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.292285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.292935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.293021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.293116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.293203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.293291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.293377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.293462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.293541] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.293634] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.293761] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.294915] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.304915] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.305199] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.306474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.306545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.306612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.306680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.306747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.306816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.306884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.306976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.307056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.307129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.307200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.307270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.307339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.307409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.307480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.307550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.307621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.307691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.307762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.307843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.307944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.308026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.308095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.308166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.308237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.308308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.308381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.308452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.308521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.308590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.308659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.308734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.308811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.308888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.309013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.309095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.309164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.309235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.309304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.309375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.309443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.309511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.309583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.309653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.309724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.309796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.309867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.309953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.310035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.310100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.310170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.310237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.310304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.310373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.310444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.310512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.310579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.310649] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.311795] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.312651] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20629, lrc_seqno=20629, guc_id=0, flags=0x73 in no process [-1] <7> [582.312654] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.312715] ------------[ cut here ]------------ <4> [582.312716] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.312717] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:28/4669 <4> [582.312787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.312850] efi_pstore nfnetlink autofs4 <4> [582.312854] CPU: 9 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.312857] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.312858] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.312859] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.312864] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.312944] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.312947] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.312951] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.312953] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.312955] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.312957] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888173fc8640 <4> [582.312959] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.312961] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [582.312964] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.312966] CR2: 00007023ec3dd000 CR3: 00000001375fd005 CR4: 0000000000f72ef0 <4> [582.312968] PKRU: 55555554 <4> [582.312970] Call Trace: <4> [582.312971] <TASK> <4> [582.312978] ? lock_acquire+0xc4/0x2c0 <4> [582.312984] ? find_held_lock+0x31/0x90 <4> [582.312989] ? lock_release+0xce/0x280 <4> [582.312998] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.313007] process_one_work+0x22e/0x6b0 <4> [582.313018] worker_thread+0x1e8/0x3d0 <4> [582.313023] ? __pfx_worker_thread+0x10/0x10 <4> [582.313026] kthread+0x11f/0x250 <4> [582.313031] ? __pfx_kthread+0x10/0x10 <4> [582.313037] ret_from_fork+0x344/0x3a0 <4> [582.313040] ? __pfx_kthread+0x10/0x10 <4> [582.313045] ret_from_fork_asm+0x1a/0x30 <4> [582.313058] </TASK> <4> [582.313060] irq event stamp: 443543 <4> [582.313062] hardirqs last enabled at (443549): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.313066] hardirqs last disabled at (443554): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.313069] softirqs last enabled at (440724): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.313072] softirqs last disabled at (440717): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.313075] ---[ end trace 0000000000000000 ]--- <7> [582.316631] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.316777] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.317990] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20696, lrc_seqno=20696, guc_id=0, flags=0x73 in no process [-1] <7> [582.317997] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.318106] ------------[ cut here ]------------ <4> [582.318108] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.318110] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#15: kworker/u64:38/6382 <4> [582.318224] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.318314] efi_pstore nfnetlink autofs4 <4> [582.318320] CPU: 15 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.318324] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.318325] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.318327] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.318335] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.318445] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.318447] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.318450] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.318452] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.318454] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.318455] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c3f40 <4> [582.318457] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.318459] FS: 0000000000000000(0000) GS:ffff8888db45d000(0000) knlGS:0000000000000000 <4> [582.318461] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.318463] CR2: 00007023f2a35000 CR3: 000000017b8d5001 CR4: 0000000000f72ef0 <4> [582.318465] PKRU: 55555554 <4> [582.318466] Call Trace: <4> [582.318468] <TASK> <4> [582.318474] ? lock_acquire+0xc4/0x2c0 <4> [582.318480] ? find_held_lock+0x31/0x90 <4> [582.318485] ? lock_release+0xce/0x280 <4> [582.318492] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.318501] process_one_work+0x22e/0x6b0 <4> [582.318511] worker_thread+0x1e8/0x3d0 <4> [582.318515] ? __pfx_worker_thread+0x10/0x10 <4> [582.318518] kthread+0x11f/0x250 <4> [582.318522] ? __pfx_kthread+0x10/0x10 <4> [582.318527] ret_from_fork+0x344/0x3a0 <4> [582.318530] ? __pfx_kthread+0x10/0x10 <4> [582.318534] ret_from_fork_asm+0x1a/0x30 <4> [582.318546] </TASK> <4> [582.318548] irq event stamp: 349997 <4> [582.318549] hardirqs last enabled at (350003): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.318553] hardirqs last disabled at (350008): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.318555] softirqs last enabled at (349002): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.318559] softirqs last disabled at (348993): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.318561] ---[ end trace 0000000000000000 ]--- <6> [582.318564] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.318674] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.318683] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.318703] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.319592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.319727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.319861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.320010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.320141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.320278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.320417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.320544] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.320690] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.320864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.322359] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.332923] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.333254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.334686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.334802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.334924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.335052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.335168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.335283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.335399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.335514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.335630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.335744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.335859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.335981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.336098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.336213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.336329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.336454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.336569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.336686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.336801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.336926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.337048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.337166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.337287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.337405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.337523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.337645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.337780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.337903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.338030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.338153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.338278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.338416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.338552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.338685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.338816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.338945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.339066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.339186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.339305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.339427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.339548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.339668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.339787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.339911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.340036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.340157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.340275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.340396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.340513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.340631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.340754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.340873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.340996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.341116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.341237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.341354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.341472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.341595] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.342824] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.343760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20696, lrc_seqno=20696, guc_id=0, flags=0x73 in no process [-1] <7> [582.343763] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.343827] ------------[ cut here ]------------ <4> [582.343829] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.343831] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:38/6382 <4> [582.343905] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.343978] efi_pstore nfnetlink autofs4 <4> [582.343983] CPU: 2 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.343986] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.343987] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.343989] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.343994] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.344065] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.344066] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.344069] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.344070] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.344071] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.344072] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c3f40 <4> [582.344073] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.344074] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.344076] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.344077] CR2: 00007023f2a45000 CR3: 00000001531e8006 CR4: 0000000000f72ef0 <4> [582.344079] PKRU: 55555554 <4> [582.344080] Call Trace: <4> [582.344081] <TASK> <4> [582.344084] ? lock_acquire+0xc4/0x2c0 <4> [582.344088] ? find_held_lock+0x31/0x90 <4> [582.344092] ? lock_release+0xce/0x280 <4> [582.344097] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.344102] process_one_work+0x22e/0x6b0 <4> [582.344109] worker_thread+0x1e8/0x3d0 <4> [582.344111] ? __pfx_worker_thread+0x10/0x10 <4> [582.344114] kthread+0x11f/0x250 <4> [582.344117] ? __pfx_kthread+0x10/0x10 <4> [582.344120] ret_from_fork+0x344/0x3a0 <4> [582.344122] ? __pfx_kthread+0x10/0x10 <4> [582.344125] ret_from_fork_asm+0x1a/0x30 <4> [582.344133] </TASK> <4> [582.344134] irq event stamp: 360709 <4> [582.344135] hardirqs last enabled at (360715): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.344138] hardirqs last disabled at (360720): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.344140] softirqs last enabled at (357992): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.344142] softirqs last disabled at (357983): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.344144] ---[ end trace 0000000000000000 ]--- <6> [582.344146] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.344214] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [582.344222] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=40, flags=0x0 in xe_compute_pree [8005] <7> [582.344224] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [582.344306] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=92, flags=0x0 in xe_compute_pree [8005] <7> [582.344312] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [582.344329] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [582.344432] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.344431] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.344541] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.345163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.345256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.345350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.345437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.345523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.345609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.345696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.345778] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.345873] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.346008] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.347102] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.356934] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.357192] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.358499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.358573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.358642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.358712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.358781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.358848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.358915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.358999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.359084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.359158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.359232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.359306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.359378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.359448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.359519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.359589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.359660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.359730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.359801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.359881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.359973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.360067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.360145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.360220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.360294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.360371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.360450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.360527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.360605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.360685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.360763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.360846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.360934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.361038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.361122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.361202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.361278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.361353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.361428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.361504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.361580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.361659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.361736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.361815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.361891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.361980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.362076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.362151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.362224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.362297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.362376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.362453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.362529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.362603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.362679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.362752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.362824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.362901] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.364091] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.364943] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20696, lrc_seqno=20696, guc_id=0, flags=0x73 in no process [-1] <7> [582.364948] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.365013] ------------[ cut here ]------------ <4> [582.365014] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.365016] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#5: kworker/u64:38/6382 <4> [582.365098] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp <7> [582.365075] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.365145] mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [582.365210] CPU: 5 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.365215] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.365217] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.365219] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.365226] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <7> [582.365218] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [582.365341] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.365344] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.365347] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.365349] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.365351] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.365352] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c3f40 <4> [582.365354] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.365356] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [582.365358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.365367] CR2: 00007023f2a45000 CR3: 00000001375fd001 CR4: 0000000000f72ef0 <4> [582.365369] PKRU: 55555554 <4> [582.365370] Call Trace: <4> [582.365371] <TASK> <4> [582.365375] ? lock_acquire+0xc4/0x2c0 <4> [582.365379] ? find_held_lock+0x31/0x90 <4> [582.365383] ? lock_release+0xce/0x280 <4> [582.365387] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.365393] process_one_work+0x22e/0x6b0 <4> [582.365400] worker_thread+0x1e8/0x3d0 <4> [582.365402] ? __pfx_worker_thread+0x10/0x10 <4> [582.365404] kthread+0x11f/0x250 <4> [582.365407] ? __pfx_kthread+0x10/0x10 <4> [582.365410] ret_from_fork+0x344/0x3a0 <4> [582.365413] ? __pfx_kthread+0x10/0x10 <4> [582.365415] ret_from_fork_asm+0x1a/0x30 <4> [582.365423] </TASK> <4> [582.365424] irq event stamp: 371431 <4> [582.365425] hardirqs last enabled at (371437): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.365428] hardirqs last disabled at (371442): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.365430] softirqs last enabled at (368252): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.365433] softirqs last disabled at (368245): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.365435] ---[ end trace 0000000000000000 ]--- <5> [582.370518] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20766, lrc_seqno=20766, guc_id=0, flags=0x73 in no process [-1] <7> [582.370527] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.370645] ------------[ cut here ]------------ <4> [582.370647] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.370649] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#13: kworker/u64:19/2428 <4> [582.370768] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.370857] efi_pstore nfnetlink autofs4 <4> [582.370864] CPU: 13 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.370868] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.370870] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.370872] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.370879] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.371002] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.371005] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.371008] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.371011] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.371013] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.371015] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888173fcb940 <4> [582.371017] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.371018] FS: 0000000000000000(0000) GS:ffff8888db35d000(0000) knlGS:0000000000000000 <4> [582.371021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.371022] CR2: 00007023f2a35000 CR3: 0000000129a38003 CR4: 0000000000f72ef0 <4> [582.371025] PKRU: 55555554 <4> [582.371026] Call Trace: <4> [582.371028] <TASK> <4> [582.371034] ? lock_acquire+0xc4/0x2c0 <4> [582.371040] ? find_held_lock+0x31/0x90 <4> [582.371045] ? lock_release+0xce/0x280 <4> [582.371053] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.371062] process_one_work+0x22e/0x6b0 <4> [582.371072] worker_thread+0x1e8/0x3d0 <4> [582.371076] ? __pfx_worker_thread+0x10/0x10 <4> [582.371079] kthread+0x11f/0x250 <4> [582.371084] ? __pfx_kthread+0x10/0x10 <4> [582.371089] ret_from_fork+0x344/0x3a0 <4> [582.371092] ? __pfx_kthread+0x10/0x10 <4> [582.371096] ret_from_fork_asm+0x1a/0x30 <4> [582.371108] </TASK> <4> [582.371110] irq event stamp: 639365 <4> [582.371111] hardirqs last enabled at (639371): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.371115] hardirqs last disabled at (639376): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.371118] softirqs last enabled at (639198): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.371121] softirqs last disabled at (639189): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.371124] ---[ end trace 0000000000000000 ]--- <6> [582.371127] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.371237] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.371246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.371304] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.372208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.372348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.372484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.372617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.372760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.372901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.373055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.373190] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.373335] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.373530] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.376241] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.386953] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.387316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.389761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.389878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.389997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.390132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.390291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.390407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.390522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.390638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.390753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.390868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.390987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.391103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.391245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.391386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.391503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.391617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.391732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.391848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.391971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.392093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.392213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.392332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.392453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.392571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.392689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.392810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.392955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.393095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.393219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.393360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.393512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.393712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.393887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.394068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.394210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.394334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.394454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.394573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.394691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.394814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.394934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.395060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.395181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.395307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.395426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.395547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.395666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.395786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.395905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.396027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.396150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.396270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.396390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.396508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.396628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.396746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.396864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.396991] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.398462] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.399567] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20766, lrc_seqno=20766, guc_id=0, flags=0x73 in no process [-1] <7> [582.399571] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.399675] ------------[ cut here ]------------ <4> [582.399676] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.399677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:19/2428 <4> [582.399750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.399811] efi_pstore nfnetlink autofs4 <4> [582.399815] CPU: 10 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.399818] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.399819] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.399820] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.399825] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.399894] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.399896] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.399898] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.399899] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.399900] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.399901] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888173fcb940 <4> [582.399903] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.399904] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [582.399905] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.399906] CR2: 00007023ec3cd000 CR3: 0000000003448001 CR4: 0000000000f72ef0 <4> [582.399908] PKRU: 55555554 <4> [582.399909] Call Trace: <4> [582.399910] <TASK> <4> [582.399914] ? lock_acquire+0xc4/0x2c0 <4> [582.399918] ? find_held_lock+0x31/0x90 <4> [582.399921] ? lock_release+0xce/0x280 <4> [582.399926] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.399931] process_one_work+0x22e/0x6b0 <4> [582.399937] worker_thread+0x1e8/0x3d0 <4> [582.399940] ? __pfx_worker_thread+0x10/0x10 <4> [582.399942] kthread+0x11f/0x250 <4> [582.399952] ? __pfx_kthread+0x10/0x10 <4> [582.399956] ret_from_fork+0x344/0x3a0 <4> [582.399958] ? __pfx_kthread+0x10/0x10 <4> [582.399961] ret_from_fork_asm+0x1a/0x30 <4> [582.399968] </TASK> <4> [582.399969] irq event stamp: 650061 <4> [582.399970] hardirqs last enabled at (650067): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.399973] hardirqs last disabled at (650072): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.399975] softirqs last enabled at (650028): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.399978] softirqs last disabled at (650023): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.399980] ---[ end trace 0000000000000000 ]--- <6> [582.399982] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.400054] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.400060] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.400135] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.400236] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.400341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.401044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.401146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.401239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.401340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.401428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.401521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.401611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.401692] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.401784] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.401939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.403166] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.412963] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.413252] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.414539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.414617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.414692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.414767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.414849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.414925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.415012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.415082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.415154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.415226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.415298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.415369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.415442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.415514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.415585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.415657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.415729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.415795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.415860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.415932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.416017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.416094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.416167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.416236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.416305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.416374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.416446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.416516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.416585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.416658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.416729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.416805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.416881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.416963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.417041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.417117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.417188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.417258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.417327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.417398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.417466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.417536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.417607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.417679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.417747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.417815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.417884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.417961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.418035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.418107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.418176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.418244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.418312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.418378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.418446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.418512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.418582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.418655] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.419850] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.420700] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20766, lrc_seqno=20766, guc_id=0, flags=0x73 in no process [-1] <7> [582.420703] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.420797] ------------[ cut here ]------------ <4> [582.420798] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.420800] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:19/2428 <4> [582.420869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.420930] efi_pstore nfnetlink autofs4 <4> [582.420934] CPU: 10 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.420937] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.420938] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.420939] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.420944] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.421027] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.421029] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.421031] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.421033] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.421034] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.421035] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888173fcb940 <4> [582.421037] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.421038] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [582.421039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.421041] CR2: 00007023ec3cd000 CR3: 0000000003448001 CR4: 0000000000f72ef0 <4> [582.421042] PKRU: 55555554 <4> [582.421043] Call Trace: <4> [582.421044] <TASK> <4> [582.421048] ? lock_acquire+0xc4/0x2c0 <4> [582.421052] ? find_held_lock+0x31/0x90 <4> [582.421056] ? lock_release+0xce/0x280 <4> [582.421061] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.421066] process_one_work+0x22e/0x6b0 <4> [582.421071] worker_thread+0x1e8/0x3d0 <4> [582.421073] ? __pfx_worker_thread+0x10/0x10 <4> [582.421075] kthread+0x11f/0x250 <4> [582.421078] ? __pfx_kthread+0x10/0x10 <4> [582.421081] ret_from_fork+0x344/0x3a0 <4> [582.421083] ? __pfx_kthread+0x10/0x10 <4> [582.421086] ret_from_fork_asm+0x1a/0x30 <4> [582.421092] </TASK> <4> [582.421093] irq event stamp: 660681 <4> [582.421095] hardirqs last enabled at (660687): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.421097] hardirqs last disabled at (660692): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.421099] softirqs last enabled at (657330): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.421102] softirqs last disabled at (657325): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.421104] ---[ end trace 0000000000000000 ]--- <7> [582.426474] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.427148] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.428427] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20819, lrc_seqno=20819, guc_id=0, flags=0x73 in no process [-1] <7> [582.428431] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.428497] ------------[ cut here ]------------ <4> [582.428498] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.428500] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:19/2428 <4> [582.428571] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.428634] efi_pstore nfnetlink autofs4 <4> [582.428638] CPU: 10 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.428641] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.428642] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.428644] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.428648] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.428717] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.428719] RSP: 0018:ffffc9000371bca0 EFLAGS: 00010246 <4> [582.428721] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.428722] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.428723] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.428724] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667e040 <4> [582.428725] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.428727] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [582.428728] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.428729] CR2: 00007023ec3cd000 CR3: 00000001f6226002 CR4: 0000000000f72ef0 <4> [582.428731] PKRU: 55555554 <4> [582.428732] Call Trace: <4> [582.428733] <TASK> <4> [582.428737] ? lock_acquire+0xc4/0x2c0 <4> [582.428741] ? find_held_lock+0x31/0x90 <4> [582.428744] ? lock_release+0xce/0x280 <4> [582.428749] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.428754] process_one_work+0x22e/0x6b0 <4> [582.428760] worker_thread+0x1e8/0x3d0 <4> [582.428763] ? __pfx_worker_thread+0x10/0x10 <4> [582.428765] kthread+0x11f/0x250 <4> [582.428768] ? __pfx_kthread+0x10/0x10 <4> [582.428772] ret_from_fork+0x344/0x3a0 <4> [582.428774] ? __pfx_kthread+0x10/0x10 <4> [582.428777] ret_from_fork_asm+0x1a/0x30 <4> [582.428784] </TASK> <4> [582.428785] irq event stamp: 661973 <4> [582.428786] hardirqs last enabled at (661979): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.428789] hardirqs last disabled at (661984): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.428791] softirqs last enabled at (660920): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.428794] softirqs last disabled at (660909): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.428796] ---[ end trace 0000000000000000 ]--- <6> [582.428797] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.428865] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.428873] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.429291] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.429885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.429982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.430073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.430158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.430241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.430325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.430409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.430491] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.430583] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.430699] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.431711] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.441975] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.442237] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.443489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.443569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.443643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.443719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.443795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.443871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.443943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.444062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.444169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.444277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.444380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.444486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.444593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.444697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.444801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.444906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.445023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.445129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.445231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.445341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.445449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.445529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.445608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.445688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.445765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.445842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.445922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.446010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.446090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.446169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.446247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.446328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.446409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.446490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.446567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.446643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.446718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.446797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.446872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.446949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.447036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.447112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.447185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.447262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.447336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.447411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.447485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.447559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.447631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.447704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.447780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.447853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.447932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.448020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.448098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.448172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.448245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.448322] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.449558] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.449997] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20819, lrc_seqno=20819, guc_id=0, flags=0x73 in no process [-1] <7> [582.450005] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.450333] ------------[ cut here ]------------ <4> [582.450336] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.450338] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:21/3726 <4> [582.450471] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.450605] efi_pstore nfnetlink autofs4 <4> [582.450613] CPU: 10 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.450619] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.450621] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.450624] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [582.450552] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.450631] <4> [582.450633] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.450749] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.450751] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.450755] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.450758] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.450760] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.450762] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667e040 <4> [582.450764] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.450766] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [582.450768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.450770] CR2: 00007023ec3cd000 CR3: 00000001f6226002 CR4: 0000000000f72ef0 <4> [582.450773] PKRU: 55555554 <4> [582.450775] Call Trace: <4> [582.450777] <TASK> <7> [582.450716] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [582.450784] ? lock_acquire+0xc4/0x2c0 <4> [582.450789] ? find_held_lock+0x31/0x90 <4> [582.450795] ? lock_release+0xce/0x280 <4> [582.450802] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.450810] process_one_work+0x22e/0x6b0 <4> [582.450819] worker_thread+0x1e8/0x3d0 <4> [582.450823] ? __pfx_worker_thread+0x10/0x10 <4> [582.450827] kthread+0x11f/0x250 <4> [582.450831] ? __pfx_kthread+0x10/0x10 <4> [582.450836] ret_from_fork+0x344/0x3a0 <4> [582.450840] ? __pfx_kthread+0x10/0x10 <4> [582.450844] ret_from_fork_asm+0x1a/0x30 <4> [582.450857] </TASK> <4> [582.450858] irq event stamp: 496317 <4> [582.450860] hardirqs last enabled at (496323): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.450864] hardirqs last disabled at (496328): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.450866] softirqs last enabled at (492828): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.450869] softirqs last disabled at (492821): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.450871] ---[ end trace 0000000000000000 ]--- <6> [582.450873] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.450942] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.450948] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.451372] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.451950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.452051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.452141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.452227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.452311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.452396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.452482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.452564] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.452659] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.452774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.453787] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.463987] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.464249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.465558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.465635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.465709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.465783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.465856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.465928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.466008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.466080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.466156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.466229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.466300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.466373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.466445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.466517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.466589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.466660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.466732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.466804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.466876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.466956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.467050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.467128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.467206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.467280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.467355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.467435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.467518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.467597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.467672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.467748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.467824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.467906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.467991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.468073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.468150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.468226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.468301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.468374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.468450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.468530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.468607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.468682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.468756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.468834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.468907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.468986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.469060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.469134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.469206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.469278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.469354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.469432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.469509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.469585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.469664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.469741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.469816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.469893] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.471077] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.471926] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20819, lrc_seqno=20819, guc_id=0, flags=0x73 in no process [-1] <7> [582.471930] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.472027] ------------[ cut here ]------------ <4> [582.472028] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.472029] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:21/3726 <4> [582.472105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.472168] efi_pstore nfnetlink autofs4 <4> [582.472172] CPU: 10 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.472175] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.472176] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.472177] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.472182] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.472251] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.472253] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.472255] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.472256] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.472257] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.472258] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667e040 <4> [582.472260] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.472261] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [582.472262] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.472264] CR2: 00007023ec3cd000 CR3: 00000001f6226002 CR4: 0000000000f72ef0 <4> [582.472265] PKRU: 55555554 <4> [582.472266] Call Trace: <4> [582.472267] <TASK> <4> [582.472271] ? lock_acquire+0xc4/0x2c0 <4> [582.472275] ? find_held_lock+0x31/0x90 <4> [582.472279] ? lock_release+0xce/0x280 <4> [582.472284] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.472289] process_one_work+0x22e/0x6b0 <4> [582.472295] worker_thread+0x1e8/0x3d0 <4> [582.472298] ? __pfx_worker_thread+0x10/0x10 <4> [582.472300] kthread+0x11f/0x250 <4> [582.472303] ? __pfx_kthread+0x10/0x10 <4> [582.472306] ret_from_fork+0x344/0x3a0 <4> [582.472309] ? __pfx_kthread+0x10/0x10 <4> [582.472312] ret_from_fork_asm+0x1a/0x30 <4> [582.472319] </TASK> <4> [582.472320] irq event stamp: 507013 <4> [582.472321] hardirqs last enabled at (507019): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.472324] hardirqs last disabled at (507024): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.472326] softirqs last enabled at (503742): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.472329] softirqs last disabled at (503735): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.472331] ---[ end trace 0000000000000000 ]--- <7> [582.479080] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.479425] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.479873] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20884, lrc_seqno=20884, guc_id=0, flags=0x73 in no process [-1] <7> [582.479877] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.479961] ------------[ cut here ]------------ <4> [582.479963] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.479965] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:21/3726 <4> [582.480100] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.480221] efi_pstore nfnetlink autofs4 <4> [582.480228] CPU: 10 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.480233] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.480235] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.480237] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.480245] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.480349] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.480352] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.480356] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.480359] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.480361] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.480363] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1b340 <4> [582.480365] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.480367] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [582.480370] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.480372] CR2: 00007023ec3cd000 CR3: 00000001f6226002 CR4: 0000000000f72ef0 <4> [582.480375] PKRU: 55555554 <4> [582.480377] Call Trace: <4> [582.480378] <TASK> <4> [582.480386] ? lock_acquire+0xc4/0x2c0 <4> [582.480391] ? find_held_lock+0x31/0x90 <4> [582.480397] ? lock_release+0xce/0x280 <4> [582.480406] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.480416] process_one_work+0x22e/0x6b0 <4> [582.480427] worker_thread+0x1e8/0x3d0 <4> [582.480431] ? __pfx_worker_thread+0x10/0x10 <4> [582.480435] kthread+0x11f/0x250 <4> [582.480440] ? __pfx_kthread+0x10/0x10 <4> [582.480446] ret_from_fork+0x344/0x3a0 <4> [582.480449] ? __pfx_kthread+0x10/0x10 <4> [582.480454] ret_from_fork_asm+0x1a/0x30 <4> [582.480467] </TASK> <4> [582.480469] irq event stamp: 509285 <4> [582.480471] hardirqs last enabled at (509291): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.480475] hardirqs last disabled at (509296): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.480479] softirqs last enabled at (508530): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.480483] softirqs last disabled at (508521): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.480486] ---[ end trace 0000000000000000 ]--- <6> [582.480489] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.480591] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.480619] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.480668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.481629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.481752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.481882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.482020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.482140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.482256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.482377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.482499] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.482629] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.482786] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.483941] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.494673] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.494987] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.496406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.496509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.496606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.496708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.496809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.496911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.497016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.497094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.497169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.497242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.497315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.497387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.497461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.497534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.497620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.497695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.497769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.497843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.497918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.498006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.498123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.498228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.498307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.498384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.498464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.498543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.498631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.498709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.498786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.498868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.498955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.499057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.499150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.499232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.499310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.499386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.499463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.499541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.499616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.499695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.499772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.499849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.499923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.500005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.500083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.500163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.500239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.500316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.500389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.500464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.500541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.500619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.500696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.500770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.500845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.500918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.500991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.501113] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.502557] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.503500] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20884, lrc_seqno=20884, guc_id=0, flags=0x73 in no process [-1] <7> [582.503503] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.503564] ------------[ cut here ]------------ <4> [582.503565] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.503566] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:21/3726 <4> [582.503635] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.503699] efi_pstore nfnetlink autofs4 <4> [582.503704] CPU: 9 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.503707] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.503708] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.503710] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.503715] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.503783] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.503784] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.503787] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.503788] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.503789] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.503790] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1b340 <4> [582.503791] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.503793] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [582.503794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.503795] CR2: 00007023f2925000 CR3: 0000000114d5c001 CR4: 0000000000f72ef0 <4> [582.503797] PKRU: 55555554 <4> [582.503798] Call Trace: <4> [582.503799] <TASK> <4> [582.503803] ? lock_acquire+0xc4/0x2c0 <4> [582.503807] ? find_held_lock+0x31/0x90 <4> [582.503810] ? lock_release+0xce/0x280 <4> [582.503815] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.503821] process_one_work+0x22e/0x6b0 <4> [582.503827] worker_thread+0x1e8/0x3d0 <4> [582.503830] ? __pfx_worker_thread+0x10/0x10 <4> [582.503832] kthread+0x11f/0x250 <4> [582.503835] ? __pfx_kthread+0x10/0x10 <4> [582.503838] ret_from_fork+0x344/0x3a0 <4> [582.503841] ? __pfx_kthread+0x10/0x10 <4> [582.503843] ret_from_fork_asm+0x1a/0x30 <4> [582.503851] </TASK> <4> [582.503852] irq event stamp: 520189 <4> [582.503853] hardirqs last enabled at (520195): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.503856] hardirqs last disabled at (520200): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.503858] softirqs last enabled at (518564): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.503861] softirqs last disabled at (518557): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.503863] ---[ end trace 0000000000000000 ]--- <6> [582.503865] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.503933] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.503939] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.504004] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.504116] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.504221] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.504818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.504904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.504994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.505100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.505188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.505272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.505357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.505437] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.505529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.505649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.506732] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.517070] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.517357] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.518617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.518688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.518756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.518824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.518891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.518957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.519035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.519108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.519180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.519253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.519324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.519395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.519466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.519536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.519606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.519677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.519748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.519818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.519887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.519967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.520060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.520139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.520218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.520293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.520366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.520442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.520521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.520597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.520677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.520757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.520836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.520919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.521001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.521099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.521176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.521253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.521329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.521407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.521483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.521561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.521636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.521709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.521782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.521862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.521940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.522020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.522095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.522172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.522246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.522318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.522394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.522468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.522542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.522615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.522689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.522766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.522840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.522919] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.524154] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.525013] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20884, lrc_seqno=20884, guc_id=0, flags=0x73 in no process [-1] <7> [582.525017] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.525079] ------------[ cut here ]------------ <4> [582.525080] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.525081] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:21/3726 <4> [582.525152] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.525216] efi_pstore nfnetlink autofs4 <4> [582.525221] CPU: 9 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.525224] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.525225] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.525226] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.525231] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.525299] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.525300] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.525302] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.525304] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.525305] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.525306] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1b340 <4> [582.525307] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.525308] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [582.525310] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.525311] CR2: 00007023f2925000 CR3: 0000000114d5c001 CR4: 0000000000f72ef0 <4> [582.525312] PKRU: 55555554 <4> [582.525313] Call Trace: <4> [582.525314] <TASK> <4> [582.525317] ? trace_hardirqs_on+0x63/0xd0 <4> [582.525322] ? lock_acquire+0xc4/0x2c0 <4> [582.525326] ? find_held_lock+0x31/0x90 <4> [582.525329] ? lock_release+0xce/0x280 <4> [582.525334] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.525339] process_one_work+0x22e/0x6b0 <4> [582.525346] worker_thread+0x1e8/0x3d0 <4> [582.525348] ? __pfx_worker_thread+0x10/0x10 <4> [582.525350] kthread+0x11f/0x250 <4> [582.525353] ? __pfx_kthread+0x10/0x10 <4> [582.525357] ret_from_fork+0x344/0x3a0 <4> [582.525359] ? __pfx_kthread+0x10/0x10 <4> [582.525362] ret_from_fork_asm+0x1a/0x30 <4> [582.525370] </TASK> <4> [582.525371] irq event stamp: 530823 <4> [582.525372] hardirqs last enabled at (530829): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.525375] hardirqs last disabled at (530834): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.525377] softirqs last enabled at (529796): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.525379] softirqs last disabled at (529789): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.525381] ---[ end trace 0000000000000000 ]--- <7> [582.531085] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.531231] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.531784] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20954, lrc_seqno=20954, guc_id=0, flags=0x73 in no process [-1] <7> [582.531791] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.531883] ------------[ cut here ]------------ <4> [582.531885] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.531888] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#5: kworker/u64:28/4669 <4> [582.531993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.532104] efi_pstore nfnetlink autofs4 <4> [582.532112] CPU: 5 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.532116] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.532118] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.532120] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.532127] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.532227] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.532230] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.532233] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.532235] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.532237] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.532238] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667bf40 <4> [582.532240] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.532241] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [582.532243] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.532245] CR2: 00007023f2925000 CR3: 0000000127fec001 CR4: 0000000000f72ef0 <4> [582.532246] PKRU: 55555554 <4> [582.532248] Call Trace: <4> [582.532249] <TASK> <4> [582.532256] ? lock_acquire+0xc4/0x2c0 <4> [582.532262] ? find_held_lock+0x31/0x90 <4> [582.532267] ? lock_release+0xce/0x280 <4> [582.532275] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.532283] process_one_work+0x22e/0x6b0 <4> [582.532294] worker_thread+0x1e8/0x3d0 <4> [582.532298] ? __pfx_worker_thread+0x10/0x10 <4> [582.532302] kthread+0x11f/0x250 <4> [582.532307] ? __pfx_kthread+0x10/0x10 <4> [582.532311] ret_from_fork+0x344/0x3a0 <4> [582.532315] ? __pfx_kthread+0x10/0x10 <4> [582.532319] ret_from_fork_asm+0x1a/0x30 <4> [582.532332] </TASK> <4> [582.532334] irq event stamp: 466795 <4> [582.532336] hardirqs last enabled at (466801): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.532340] hardirqs last disabled at (466806): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.532342] softirqs last enabled at (466124): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.532345] softirqs last disabled at (466119): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.532349] ---[ end trace 0000000000000000 ]--- <6> [582.532351] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.532447] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.532456] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.532509] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.533486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.533616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.533749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.533882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.534005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.534151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.534275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.534388] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.534526] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.534698] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.536009] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.546824] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.547159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.548720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.548822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.548918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.549027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.549128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.549247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.549364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.549482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.549579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.549675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.549776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.549874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.549984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.550115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.550223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.550322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.550419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.550532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.550648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.550753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.550858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.550963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.551082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.551182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.551282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.551384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.551494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.551596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.551842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.552028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.552147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.552384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.552528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.552638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.552759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.552865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.552970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.553087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.553187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.553293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.553400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.553503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.553602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.553706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.553805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.553903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.554000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.554115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.554218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.554318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.554422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.554526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.554626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.554724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.554824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.554928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.555032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.555136] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.555934] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.556178] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20954, lrc_seqno=20954, guc_id=0, flags=0x73 in no process [-1] <7> [582.556186] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.556289] ------------[ cut here ]------------ <4> [582.556292] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.556293] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:21/3726 <4> [582.556371] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.556442] efi_pstore nfnetlink autofs4 <4> [582.556448] CPU: 9 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.556451] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.556452] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.556453] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.556460] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.556537] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.556539] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.556541] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.556542] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.556543] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.556544] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667bf40 <4> [582.556545] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.556547] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [582.556548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.556549] CR2: 00007023f2925000 CR3: 0000000114d5c001 CR4: 0000000000f72ef0 <4> [582.556551] PKRU: 55555554 <4> [582.556552] Call Trace: <4> [582.556553] <TASK> <4> [582.556557] ? lock_acquire+0xc4/0x2c0 <4> [582.556562] ? find_held_lock+0x31/0x90 <4> [582.556565] ? lock_release+0xce/0x280 <4> [582.556570] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.556576] process_one_work+0x22e/0x6b0 <4> [582.556582] worker_thread+0x1e8/0x3d0 <4> [582.556584] ? __pfx_worker_thread+0x10/0x10 <4> [582.556586] kthread+0x11f/0x250 <4> [582.556590] ? __pfx_kthread+0x10/0x10 <4> [582.556593] ret_from_fork+0x344/0x3a0 <4> [582.556596] ? __pfx_kthread+0x10/0x10 <4> [582.556599] ret_from_fork_asm+0x1a/0x30 <4> [582.556607] </TASK> <4> [582.556608] irq event stamp: 537193 <4> [582.556609] hardirqs last enabled at (537199): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.556612] hardirqs last disabled at (537204): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.556614] softirqs last enabled at (533592): [<ffffffff81334683>] kernel_fpu_end+0x53/0x70 <4> [582.556616] softirqs last disabled at (533590): [<ffffffff81334d34>] kernel_fpu_begin_mask+0xc4/0x120 <4> [582.556619] ---[ end trace 0000000000000000 ]--- <6> [582.556622] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.556702] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.556712] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.557224] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.557344] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.557458] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.558152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.558244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.558349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.558437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.558535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.558629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.558717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.558801] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.558899] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.559033] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.560253] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.570040] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.570338] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.572034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.572107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.572176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.572254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.572333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.572411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.572520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.572589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.572668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.572746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.572824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.572902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.572979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.573060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.573137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.573209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.573281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.573348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.573415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.573493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.573572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.573649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.573728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.573803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.573882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.573962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.574051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.574129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.574210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.574292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.574372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.574490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.574703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.574819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.574901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.574970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.575043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.575121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.575195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.575275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.575354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.575430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.575504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.575581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.575655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.575728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.575799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.575873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.575945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.576022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.576113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.576184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.576252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.576321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.576390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.576456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.576526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.576600] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.577778] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.578634] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20954, lrc_seqno=20954, guc_id=0, flags=0x73 in no process [-1] <7> [582.578637] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.578701] ------------[ cut here ]------------ <4> [582.578702] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.578703] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#9: kworker/u64:21/3726 <4> [582.578778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.578840] efi_pstore nfnetlink autofs4 <4> [582.578844] CPU: 9 UID: 0 PID: 3726 Comm: kworker/u64:21 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.578847] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.578848] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.578849] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.578854] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.578922] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.578924] RSP: 0018:ffffc9000560fca0 EFLAGS: 00010246 <4> [582.578926] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.578927] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.578928] RBP: ffffc9000560fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.578929] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817667bf40 <4> [582.578930] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.578932] FS: 0000000000000000(0000) GS:ffff8888db15d000(0000) knlGS:0000000000000000 <4> [582.578933] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.578934] CR2: 00007023f2925000 CR3: 0000000114d5c001 CR4: 0000000000f72ef0 <4> [582.578936] PKRU: 55555554 <4> [582.578937] Call Trace: <4> [582.578938] <TASK> <4> [582.578941] ? lock_acquire+0xc4/0x2c0 <4> [582.578945] ? find_held_lock+0x31/0x90 <4> [582.578948] ? lock_release+0xce/0x280 <4> [582.578953] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.578959] process_one_work+0x22e/0x6b0 <4> [582.578965] worker_thread+0x1e8/0x3d0 <4> [582.578967] ? __pfx_worker_thread+0x10/0x10 <4> [582.578970] kthread+0x11f/0x250 <4> [582.578973] ? __pfx_kthread+0x10/0x10 <4> [582.578976] ret_from_fork+0x344/0x3a0 <4> [582.578979] ? __pfx_kthread+0x10/0x10 <4> [582.578981] ret_from_fork_asm+0x1a/0x30 <4> [582.578989] </TASK> <4> [582.578990] irq event stamp: 547831 <4> [582.578991] hardirqs last enabled at (547837): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.578994] hardirqs last disabled at (547842): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.578995] softirqs last enabled at (545458): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.578998] softirqs last disabled at (545451): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.579000] ---[ end trace 0000000000000000 ]--- <7> [582.583087] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.583228] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.584101] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21024, lrc_seqno=21024, guc_id=0, flags=0x73 in no process [-1] <7> [582.584105] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.584170] ------------[ cut here ]------------ <4> [582.584172] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.584173] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:30/6373 <4> [582.584248] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.584311] efi_pstore nfnetlink autofs4 <4> [582.584315] CPU: 2 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.584318] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.584319] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.584320] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.584325] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.584395] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.584397] RSP: 0018:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [582.584399] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.584400] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.584401] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.584403] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88823b419540 <4> [582.584404] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.584405] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.584406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.584408] CR2: 00007023ec2ad000 CR3: 000000012fb3a002 CR4: 0000000000f72ef0 <4> [582.584409] PKRU: 55555554 <4> [582.584410] Call Trace: <4> [582.584411] <TASK> <4> [582.584415] ? lock_acquire+0xc4/0x2c0 <4> [582.584419] ? find_held_lock+0x31/0x90 <4> [582.584423] ? lock_release+0xce/0x280 <4> [582.584428] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.584433] process_one_work+0x22e/0x6b0 <4> [582.584440] worker_thread+0x1e8/0x3d0 <4> [582.584442] ? __pfx_worker_thread+0x10/0x10 <4> [582.584444] kthread+0x11f/0x250 <4> [582.584447] ? __pfx_kthread+0x10/0x10 <4> [582.584451] ret_from_fork+0x344/0x3a0 <4> [582.584453] ? __pfx_kthread+0x10/0x10 <4> [582.584456] ret_from_fork_asm+0x1a/0x30 <4> [582.584463] </TASK> <4> [582.584464] irq event stamp: 241851 <4> [582.584465] hardirqs last enabled at (241857): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.584468] hardirqs last disabled at (241862): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.584470] softirqs last enabled at (240852): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.584473] softirqs last disabled at (240847): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.584475] ---[ end trace 0000000000000000 ]--- <6> [582.584476] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.584547] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.584555] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.584612] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.585665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.585786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.585925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.586060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.586189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.586303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.586415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.586523] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.586642] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.586827] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.588203] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.598056] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.598401] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.600096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.600201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.600300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.600403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.600541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.600693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.600804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.601057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.601175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.601305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.601447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.601561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.601683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.601805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.601924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.602053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.602156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.602274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.602375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.602480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.602583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.602688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.602797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.602903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.603000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.603286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.603413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.603565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.603744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.603851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.603962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.604127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.604306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.604434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.604578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.604679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.604778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.604884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.604989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.605126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.605234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.605333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.605429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.605531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.605629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.605731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.605835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.605938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.606035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.606175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.606279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.606380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.606482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.606584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.606685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.606784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.606884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.606988] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.608713] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.610587] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21024, lrc_seqno=21024, guc_id=0, flags=0x73 in no process [-1] <7> [582.610593] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [582.610601] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.610708] ------------[ cut here ]------------ <4> [582.610710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.610711] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#12: kworker/u64:39/6383 <7> [582.610739] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [582.610826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.610922] efi_pstore nfnetlink autofs4 <4> [582.610928] CPU: 12 UID: 0 PID: 6383 Comm: kworker/u64:39 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.610932] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.610934] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.610936] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.610943] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.611061] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.611064] RSP: 0018:ffffc9000ab97ca0 EFLAGS: 00010246 <4> [582.611067] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.611070] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.611071] RBP: ffffc9000ab97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.611073] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88823b419540 <4> [582.611075] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.611077] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [582.611079] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.611081] CR2: 00007023ec2bd000 CR3: 00000001375fd002 CR4: 0000000000f72ef0 <4> [582.611083] PKRU: 55555554 <4> [582.611085] Call Trace: <4> [582.611086] <TASK> <4> [582.611092] ? lock_acquire+0xc4/0x2c0 <4> [582.611098] ? find_held_lock+0x31/0x90 <4> [582.611103] ? lock_release+0xce/0x280 <4> [582.611110] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.611119] process_one_work+0x22e/0x6b0 <4> [582.611129] worker_thread+0x1e8/0x3d0 <4> [582.611133] ? __pfx_worker_thread+0x10/0x10 <4> [582.611137] kthread+0x11f/0x250 <4> [582.611141] ? __pfx_kthread+0x10/0x10 <4> [582.611146] ret_from_fork+0x344/0x3a0 <4> [582.611149] ? __pfx_kthread+0x10/0x10 <4> [582.611153] ret_from_fork_asm+0x1a/0x30 <4> [582.611165] </TASK> <4> [582.611166] irq event stamp: 423191 <4> [582.611168] hardirqs last enabled at (423197): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.611172] hardirqs last disabled at (423202): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.611175] softirqs last enabled at (423022): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.611178] softirqs last disabled at (423015): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.611181] ---[ end trace 0000000000000000 ]--- <6> [582.611184] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.611299] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.611318] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.611381] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.612089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.612189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.612286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.612391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.612496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.612596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.612701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.612782] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.612876] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.613017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.614336] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.625078] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.625390] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.628044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.628139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.628213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.628316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.628416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.628752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.628850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.629024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.629588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.629724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.629830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.629900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.629970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.630042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.630151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.630223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.630298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.630390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.630474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.630552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.630630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.630706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.630786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.630861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.630935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.631013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.631126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.631208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.631317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.631401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.631488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.631623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.631735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.631876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.631983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.632066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.632142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.632215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.632289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.632366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.632439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.632512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.632588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.632669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.632744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.632818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.632891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.632966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.633037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.633123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.633204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.633281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.633350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.633416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.633484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.633550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.633619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.633692] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.634989] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.635944] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21024, lrc_seqno=21024, guc_id=0, flags=0x73 in no process [-1] <7> [582.635948] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.636040] ------------[ cut here ]------------ <4> [582.636041] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.636043] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:39/6383 <4> [582.636185] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.636306] efi_pstore nfnetlink autofs4 <4> [582.636314] CPU: 2 UID: 0 PID: 6383 Comm: kworker/u64:39 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.636318] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.636320] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.636322] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.636331] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.636434] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.636437] RSP: 0018:ffffc9000ab97ca0 EFLAGS: 00010246 <4> [582.636441] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.636443] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.636446] RBP: ffffc9000ab97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.636448] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88823b419540 <4> [582.636450] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.636452] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.636455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.636457] CR2: 00007023f2b86000 CR3: 0000000153e00003 CR4: 0000000000f72ef0 <4> [582.636460] PKRU: 55555554 <4> [582.636462] Call Trace: <4> [582.636463] <TASK> <4> [582.636471] ? lock_acquire+0xc4/0x2c0 <4> [582.636477] ? find_held_lock+0x31/0x90 <4> [582.636483] ? lock_release+0xce/0x280 <4> [582.636492] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.636502] process_one_work+0x22e/0x6b0 <4> [582.636514] worker_thread+0x1e8/0x3d0 <4> [582.636518] ? __pfx_worker_thread+0x10/0x10 <4> [582.636522] kthread+0x11f/0x250 <4> [582.636527] ? __pfx_kthread+0x10/0x10 <4> [582.636533] ret_from_fork+0x344/0x3a0 <4> [582.636536] ? __pfx_kthread+0x10/0x10 <4> [582.636541] ret_from_fork_asm+0x1a/0x30 <4> [582.636555] </TASK> <4> [582.636557] irq event stamp: 433893 <4> [582.636559] hardirqs last enabled at (433899): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.636564] hardirqs last disabled at (433904): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.636567] softirqs last enabled at (433138): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.636571] softirqs last disabled at (433093): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.636574] ---[ end trace 0000000000000000 ]--- <7> [582.640657] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.640800] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.641413] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21094, lrc_seqno=21094, guc_id=0, flags=0x73 in no process [-1] <7> [582.641416] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.641480] ------------[ cut here ]------------ <4> [582.641482] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.641483] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:39/6383 <4> [582.641555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.641617] efi_pstore nfnetlink autofs4 <4> [582.641621] CPU: 2 UID: 0 PID: 6383 Comm: kworker/u64:39 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.641625] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.641626] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.641627] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.641632] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.641701] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.641702] RSP: 0018:ffffc9000ab97ca0 EFLAGS: 00010246 <4> [582.641704] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.641706] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.641707] RBP: ffffc9000ab97da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.641708] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c3040 <4> [582.641709] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.641710] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.641711] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.641713] CR2: 00007023f2b86000 CR3: 0000000153e00003 CR4: 0000000000f72ef0 <4> [582.641714] PKRU: 55555554 <4> [582.641715] Call Trace: <4> [582.641716] <TASK> <4> [582.641720] ? lock_acquire+0xc4/0x2c0 <4> [582.641724] ? find_held_lock+0x31/0x90 <4> [582.641727] ? lock_release+0xce/0x280 <4> [582.641732] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.641737] process_one_work+0x22e/0x6b0 <4> [582.641743] worker_thread+0x1e8/0x3d0 <4> [582.641746] ? __pfx_worker_thread+0x10/0x10 <4> [582.641748] kthread+0x11f/0x250 <4> [582.641751] ? __pfx_kthread+0x10/0x10 <4> [582.641754] ret_from_fork+0x344/0x3a0 <4> [582.641756] ? __pfx_kthread+0x10/0x10 <4> [582.641759] ret_from_fork_asm+0x1a/0x30 <4> [582.641767] </TASK> <4> [582.641768] irq event stamp: 436507 <4> [582.641769] hardirqs last enabled at (436513): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.641771] hardirqs last disabled at (436518): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.641773] softirqs last enabled at (434766): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.641776] softirqs last disabled at (434759): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.641778] ---[ end trace 0000000000000000 ]--- <6> [582.641779] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.641849] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.641858] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.641910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.642762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.642878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.643007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.643132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.643221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.643307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.643394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.643482] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.643575] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.643755] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.645157] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.655086] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.655431] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.657732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.657820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.657896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.658084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.658300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.658388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.658517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.658774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.658987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.659080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.659297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.659382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.659802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.659886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.660268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.660743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.660829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.661099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.661392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.661475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.661556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.661633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.661711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.661786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.661861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.661938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.662103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.662255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.662381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.662626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.662825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.663182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.663467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.663799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.663976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.664057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.664160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.664239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.664314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.664391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.664467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.664542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.664615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.664693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.664768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.664843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.664919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.664998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.665074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.665173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.665251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.665324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.665397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.665473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.665553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.665629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.665704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.665781] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.667596] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.668893] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21094, lrc_seqno=21094, guc_id=0, flags=0x73 in no process [-1] <7> [582.668896] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.668965] ------------[ cut here ]------------ <4> [582.668966] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.668968] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#3: kworker/u64:28/4669 <4> [582.669040] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.669111] efi_pstore nfnetlink autofs4 <4> [582.669117] CPU: 3 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.669120] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.669121] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.669123] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.669128] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.669199] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.669200] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.669202] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.669204] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.669205] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.669206] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c3040 <4> [582.669207] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.669208] FS: 0000000000000000(0000) GS:ffff8888dae5d000(0000) knlGS:0000000000000000 <4> [582.669210] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.669211] CR2: 00007023ec2bd000 CR3: 00000001375fd006 CR4: 0000000000f72ef0 <4> [582.669212] PKRU: 55555554 <4> [582.669213] Call Trace: <4> [582.669214] <TASK> <4> [582.669218] ? lock_acquire+0xc4/0x2c0 <4> [582.669223] ? find_held_lock+0x31/0x90 <4> [582.669227] ? lock_release+0xce/0x280 <4> [582.669232] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.669237] process_one_work+0x22e/0x6b0 <4> [582.669243] worker_thread+0x1e8/0x3d0 <4> [582.669246] ? __pfx_worker_thread+0x10/0x10 <4> [582.669248] kthread+0x11f/0x250 <4> [582.669251] ? __pfx_kthread+0x10/0x10 <4> [582.669254] ret_from_fork+0x344/0x3a0 <4> [582.669257] ? __pfx_kthread+0x10/0x10 <4> [582.669260] ret_from_fork_asm+0x1a/0x30 <4> [582.669267] </TASK> <4> [582.669268] irq event stamp: 494661 <4> [582.669269] hardirqs last enabled at (494667): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.669272] hardirqs last disabled at (494672): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.669274] softirqs last enabled at (491416): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.669277] softirqs last disabled at (491385): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.669279] ---[ end trace 0000000000000000 ]--- <6> [582.669281] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.669349] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.669357] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.669407] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.669530] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.669657] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.670715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.670811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.670956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.671049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.671184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.671302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.671396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.671479] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.671597] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.671791] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.673216] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.683106] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.683487] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.685349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.685462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.685558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.686096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.686732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.686921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.687059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.687965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.688096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.688203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.689081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.689273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.689551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.689731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.689853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.690098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.690213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.690331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.690487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.690592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.690696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.690796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.690909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.691010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.691123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.691230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.691439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.691588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.691725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.691861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.691995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.692210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.692353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.692475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.692723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.692803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.692879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.692955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.693033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.693125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.693206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.693282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.693358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.693441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.693518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.693595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.693670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.693748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.693822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.693896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.693971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.694046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.694127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.694201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.694277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.694354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.694430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.694509] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.695982] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.697133] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21094, lrc_seqno=21094, guc_id=0, flags=0x73 in no process [-1] <7> [582.697140] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.697225] ------------[ cut here ]------------ <4> [582.697226] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.697228] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:28/4669 <4> [582.697298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad <7> [582.697326] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.697406] wmi <4> [582.697408] acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [582.697421] CPU: 2 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.697425] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.697426] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.697428] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.697435] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.697547] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.697550] RSP: 0000:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.697553] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.697556] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <7> [582.697484] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [582.697558] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.697559] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881713c3040 <4> [582.697561] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.697563] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.697565] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.697567] CR2: 00007023f0d35000 CR3: 0000000003448005 CR4: 0000000000f72ef0 <4> [582.697569] PKRU: 55555554 <4> [582.697570] Call Trace: <4> [582.697571] <TASK> <4> [582.697577] ? lock_acquire+0xc4/0x2c0 <4> [582.697582] ? find_held_lock+0x31/0x90 <4> [582.697586] ? lock_release+0xce/0x280 <4> [582.697593] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.697603] process_one_work+0x22e/0x6b0 <4> [582.697613] worker_thread+0x1e8/0x3d0 <4> [582.697617] ? __pfx_worker_thread+0x10/0x10 <4> [582.697621] kthread+0x11f/0x250 <4> [582.697625] ? __pfx_kthread+0x10/0x10 <4> [582.697631] ret_from_fork+0x344/0x3a0 <4> [582.697634] ? __pfx_kthread+0x10/0x10 <4> [582.697638] ret_from_fork_asm+0x1a/0x30 <4> [582.697646] </TASK> <4> [582.697647] irq event stamp: 505363 <4> [582.697648] hardirqs last enabled at (505369): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.697651] hardirqs last disabled at (505374): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.697653] softirqs last enabled at (502146): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.697655] softirqs last disabled at (502139): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.697658] ---[ end trace 0000000000000000 ]--- <5> [582.702550] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21164, lrc_seqno=21164, guc_id=0, flags=0x73 in no process [-1] <7> [582.702555] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.702661] ------------[ cut here ]------------ <4> [582.702663] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.702665] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#2: kworker/u64:28/4669 <4> [582.702764] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.702859] efi_pstore nfnetlink autofs4 <4> [582.702869] CPU: 2 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.702873] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.702874] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.702876] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.702884] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.702983] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.702986] RSP: 0000:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.702989] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.702991] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.702993] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.702994] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817c982740 <4> [582.702996] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.702998] FS: 0000000000000000(0000) GS:ffff8888daddd000(0000) knlGS:0000000000000000 <4> [582.703000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.703001] CR2: 00007023f0d35000 CR3: 000000012c202006 CR4: 0000000000f72ef0 <4> [582.703004] PKRU: 55555554 <4> [582.703006] Call Trace: <4> [582.703009] <TASK> <4> [582.703016] ? lock_acquire+0xc4/0x2c0 <4> [582.703020] ? find_held_lock+0x31/0x90 <4> [582.703026] ? lock_release+0xce/0x280 <4> [582.703035] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.703043] process_one_work+0x22e/0x6b0 <4> [582.703053] worker_thread+0x1e8/0x3d0 <4> [582.703058] ? __pfx_worker_thread+0x10/0x10 <4> [582.703061] kthread+0x11f/0x250 <4> [582.703068] ? __pfx_kthread+0x10/0x10 <4> [582.703074] ret_from_fork+0x344/0x3a0 <4> [582.703077] ? __pfx_kthread+0x10/0x10 <4> [582.703081] ret_from_fork_asm+0x1a/0x30 <4> [582.703092] </TASK> <4> [582.703104] irq event stamp: 507597 <4> [582.703106] hardirqs last enabled at (507603): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.703110] hardirqs last disabled at (507608): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.703113] softirqs last enabled at (505764): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.703116] softirqs last disabled at (505759): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.703119] ---[ end trace 0000000000000000 ]--- <6> [582.703122] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.703224] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.703236] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.703298] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.704679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.704838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.705004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.705124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.705281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.705406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.705560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.705671] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.705826] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.706044] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.707820] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.718136] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.718689] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.723241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.723357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.723457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.723653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.723919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.724027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.724193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.724710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.724822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.725101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.725335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.726117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.726388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.726487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.726821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.727005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.727117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.727298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.727599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.727708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.727812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.727920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.728022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.728133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.728238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.728350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.728526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.728931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.729117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.729256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.729397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.729828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.730186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.731294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.731431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.731548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.731655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.731758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.731860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.731968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.732068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.732184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.732289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.732405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.732513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.732618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.732719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.732820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.732916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.733022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.733146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.733253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.733355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.733456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.733557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.733654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.733752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.733853] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.736343] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.739139] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21164, lrc_seqno=21164, guc_id=0, flags=0x73 in no process [-1] <7> [582.739148] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.739290] ------------[ cut here ]------------ <4> [582.739292] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.739294] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#13: kworker/u64:28/4669 <4> [582.739409] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.739505] efi_pstore nfnetlink autofs4 <4> [582.739511] CPU: 13 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.739515] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.739517] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.739520] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.739530] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.739642] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.739645] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.739648] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.739650] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.739652] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.739653] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817c982740 <4> [582.739655] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.739657] FS: 0000000000000000(0000) GS:ffff8888db35d000(0000) knlGS:0000000000000000 <4> [582.739659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.739661] CR2: 00007023f2b86000 CR3: 00000001375fd005 CR4: 0000000000f72ef0 <4> [582.739663] PKRU: 55555554 <4> [582.739665] Call Trace: <4> [582.739666] <TASK> <4> [582.739673] ? lock_acquire+0xc4/0x2c0 <4> [582.739681] ? find_held_lock+0x31/0x90 <4> [582.739686] ? lock_release+0xce/0x280 <4> [582.739694] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.739703] process_one_work+0x22e/0x6b0 <4> [582.739714] worker_thread+0x1e8/0x3d0 <4> [582.739718] ? __pfx_worker_thread+0x10/0x10 <4> [582.739721] kthread+0x11f/0x250 <4> [582.739726] ? __pfx_kthread+0x10/0x10 <4> [582.739731] ret_from_fork+0x344/0x3a0 <4> [582.739734] ? __pfx_kthread+0x10/0x10 <4> [582.739738] ret_from_fork_asm+0x1a/0x30 <4> [582.739751] </TASK> <4> [582.739753] irq event stamp: 518375 <4> [582.739754] hardirqs last enabled at (518381): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.739758] hardirqs last disabled at (518386): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.739761] softirqs last enabled at (517552): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.739764] softirqs last disabled at (517543): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.739767] ---[ end trace 0000000000000000 ]--- <6> [582.739770] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.739886] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.739900] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.740568] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.740749] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.740910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.742383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.742549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.742736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.742933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.743137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.743296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.743486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.743622] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.743777] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.744037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.748350] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.759167] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.759691] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.762896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.763024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.763144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.763287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.763542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.763814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.763989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.764134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.764424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.764553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.764669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.764793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.764912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.765052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.765189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.765310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.765428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.765543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.765676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.765796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.765917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.766036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.766164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.766284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.766402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.766523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.766670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.766809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.766932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.767066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.767191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.767333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.767473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.767623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.767774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.767899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.768019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.768142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.768262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.768385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.768505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.768625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.768743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.768867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.768987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.769107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.769230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.769350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.769468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.769586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.769708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.769827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.769947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.770065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.770189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.770307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.770425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.770547] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.771912] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.773160] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21164, lrc_seqno=21164, guc_id=0, flags=0x73 in no process [-1] <7> [582.773165] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.773238] ------------[ cut here ]------------ <4> [582.773239] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.773241] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#0: kworker/u64:28/4669 <4> [582.773309] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.773369] efi_pstore nfnetlink autofs4 <4> [582.773373] CPU: 0 UID: 0 PID: 4669 Comm: kworker/u64:28 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.773376] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.773377] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.773378] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.773383] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <7> [582.773364] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [582.773448] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.773449] RSP: 0018:ffffc9000381bca0 EFLAGS: 00010246 <4> [582.773451] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.773452] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.773453] RBP: ffffc9000381bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.773454] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88817c982740 <4> [582.773455] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.773456] FS: 0000000000000000(0000) GS:ffff8888dacdd000(0000) knlGS:0000000000000000 <4> [582.773457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.773458] CR2: 00007023f2b86000 CR3: 00000001232ce002 CR4: 0000000000f72ef0 <4> [582.773459] PKRU: 55555554 <4> [582.773460] Call Trace: <4> [582.773461] <TASK> <4> [582.773465] ? lock_acquire+0xc4/0x2c0 <4> [582.773469] ? find_held_lock+0x31/0x90 <4> [582.773472] ? lock_release+0xce/0x280 <4> [582.773476] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.773481] process_one_work+0x22e/0x6b0 <4> [582.773487] worker_thread+0x1e8/0x3d0 <4> [582.773489] ? __pfx_worker_thread+0x10/0x10 <4> [582.773491] kthread+0x11f/0x250 <4> [582.773494] ? __pfx_kthread+0x10/0x10 <4> [582.773497] ret_from_fork+0x344/0x3a0 <4> [582.773499] ? __pfx_kthread+0x10/0x10 <4> [582.773501] ret_from_fork_asm+0x1a/0x30 <4> [582.773508] </TASK> <4> [582.773509] irq event stamp: 529133 <4> [582.773510] hardirqs last enabled at (529139): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.773513] hardirqs last disabled at (529144): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.773514] softirqs last enabled at (525688): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.773517] softirqs last disabled at (525679): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.773518] ---[ end trace 0000000000000000 ]--- <7> [582.773525] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.778315] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21234, lrc_seqno=21234, guc_id=0, flags=0x73 in no process [-1] <7> [582.778323] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.778444] ------------[ cut here ]------------ <4> [582.778446] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.778448] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#12: kworker/u64:38/6382 <4> [582.778568] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.778661] efi_pstore nfnetlink autofs4 <4> [582.778668] CPU: 12 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.778672] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.778674] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.778676] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.778684] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.778801] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.778803] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.778807] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.778809] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.778810] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.778812] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888235f5ad40 <4> [582.778814] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.778816] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [582.778818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.778820] CR2: 00007023f2915000 CR3: 000000012f9c1006 CR4: 0000000000f72ef0 <4> [582.778822] PKRU: 55555554 <4> [582.778823] Call Trace: <4> [582.778825] <TASK> <4> [582.778832] ? lock_acquire+0xc4/0x2c0 <4> [582.778837] ? find_held_lock+0x31/0x90 <4> [582.778842] ? lock_release+0xce/0x280 <4> [582.778850] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.778860] process_one_work+0x22e/0x6b0 <4> [582.778870] worker_thread+0x1e8/0x3d0 <4> [582.778874] ? __pfx_worker_thread+0x10/0x10 <4> [582.778877] kthread+0x11f/0x250 <4> [582.778882] ? __pfx_kthread+0x10/0x10 <4> [582.778887] ret_from_fork+0x344/0x3a0 <4> [582.778890] ? __pfx_kthread+0x10/0x10 <4> [582.778894] ret_from_fork_asm+0x1a/0x30 <4> [582.778908] </TASK> <4> [582.778910] irq event stamp: 386085 <4> [582.778911] hardirqs last enabled at (386091): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.778915] hardirqs last disabled at (386096): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.778917] softirqs last enabled at (384906): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.778921] softirqs last disabled at (384843): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.778924] ---[ end trace 0000000000000000 ]--- <6> [582.778927] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.779044] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.779053] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.779105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.780095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.780251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.780391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.780537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.780677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.780803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.780934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.781069] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.781230] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.781494] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.784891] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.795160] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.795569] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.799354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.799476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.799590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.799969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.800132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.800341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.800796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.801153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.802129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.802624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.802867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.803117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.803276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.803400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.804091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.804330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.805123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.805251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.805823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.805943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.806064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.806187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.806308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.806426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.806545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.806667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.806792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.807157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.807429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.807756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.808065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.808370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.808715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.808975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.809160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.809284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.809405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.809525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.809643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.809767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.809887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.810007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.810126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.810254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.810375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.810494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.810613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.810734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.810852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.810972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.811099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.811227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.811355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.811478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.811600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.811719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.811838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.811964] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.814002] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.815176] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21234, lrc_seqno=21234, guc_id=0, flags=0x73 in no process [-1] <7> [582.815184] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.815309] ------------[ cut here ]------------ <4> [582.815310] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.815312] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#15: kworker/u64:38/6382 <4> [582.815428] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.815517] efi_pstore nfnetlink autofs4 <4> [582.815524] CPU: 15 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.815529] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.815530] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.815533] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.815541] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.815655] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.815658] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.815661] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.815663] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.815664] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.815666] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888235f5ad40 <4> [582.815668] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.815670] FS: 0000000000000000(0000) GS:ffff8888db45d000(0000) knlGS:0000000000000000 <4> [582.815672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.815674] CR2: 00007572c9568000 CR3: 00000001375fd004 CR4: 0000000000f72ef0 <4> [582.815676] PKRU: 55555554 <4> [582.815678] Call Trace: <4> [582.815680] <TASK> <4> [582.815686] ? lock_acquire+0xc4/0x2c0 <4> [582.815692] ? find_held_lock+0x31/0x90 <4> [582.815697] ? lock_release+0xce/0x280 <4> [582.815704] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.815713] process_one_work+0x22e/0x6b0 <4> [582.815724] worker_thread+0x1e8/0x3d0 <4> [582.815728] ? __pfx_worker_thread+0x10/0x10 <4> [582.815731] kthread+0x11f/0x250 <4> [582.815735] ? __pfx_kthread+0x10/0x10 <4> [582.815740] ret_from_fork+0x344/0x3a0 <4> [582.815743] ? __pfx_kthread+0x10/0x10 <4> [582.815747] ret_from_fork_asm+0x1a/0x30 <4> [582.815759] </TASK> <4> [582.815761] irq event stamp: 396761 <4> [582.815762] hardirqs last enabled at (396767): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.815766] hardirqs last disabled at (396772): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.815769] softirqs last enabled at (395362): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.815773] softirqs last disabled at (395357): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.815776] ---[ end trace 0000000000000000 ]--- <6> [582.815779] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.815893] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.815906] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.817717] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.817890] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.818048] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.819233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.819443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.819622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.819762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.819914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.820064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.820230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.820367] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.820528] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.820757] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.824409] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.835201] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.835533] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.837245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.837361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.837475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.837600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.837726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.837844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.837962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.838079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.838203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.838322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.838439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.838554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.838669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.838784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.838899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.839014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.839129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.839249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.839365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.839486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.839606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.839725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.839846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.839964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.840083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.840209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.840336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.840458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.840578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.840700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.840821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.840948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.841074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.841205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.841330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.841453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.841573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.841693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.841811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.841934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.842055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.842182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.842302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.842426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.842545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.842665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.842783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.842903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.843021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.843139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.843265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.843385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.843505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.843623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.843743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.843861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.843979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.844102] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.845442] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.846314] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21234, lrc_seqno=21234, guc_id=0, flags=0x73 in no process [-1] <7> [582.846318] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.846379] ------------[ cut here ]------------ <4> [582.846381] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.846383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#6: kworker/u64:38/6382 <4> [582.846457] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.846514] efi_pstore nfnetlink autofs4 <4> [582.846519] CPU: 6 UID: 0 PID: 6382 Comm: kworker/u64:38 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.846521] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.846522] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.846523] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.846528] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.846592] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.846593] RSP: 0018:ffffc9000ab8fca0 EFLAGS: 00010246 <4> [582.846595] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.846596] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.846597] RBP: ffffc9000ab8fda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.846598] R10: 0000000000000000 R11: 0000000000000000 R12: ffff888235f5ad40 <4> [582.846599] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.846600] FS: 0000000000000000(0000) GS:ffff8888dafdd000(0000) knlGS:0000000000000000 <4> [582.846602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.846603] CR2: 00006183e94a2048 CR3: 000000017b9e0005 CR4: 0000000000f72ef0 <4> [582.846604] PKRU: 55555554 <4> [582.846605] Call Trace: <4> [582.846606] <TASK> <4> [582.846610] ? lock_acquire+0xc4/0x2c0 <4> [582.846613] ? find_held_lock+0x31/0x90 <4> [582.846616] ? lock_release+0xce/0x280 <4> [582.846621] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.846626] process_one_work+0x22e/0x6b0 <4> [582.846632] worker_thread+0x1e8/0x3d0 <4> [582.846634] ? __pfx_worker_thread+0x10/0x10 <4> [582.846636] kthread+0x11f/0x250 <4> [582.846639] ? __pfx_kthread+0x10/0x10 <4> [582.846642] ret_from_fork+0x344/0x3a0 <4> [582.846644] ? __pfx_kthread+0x10/0x10 <4> [582.846646] ret_from_fork_asm+0x1a/0x30 <4> [582.846653] </TASK> <4> [582.846655] irq event stamp: 407493 <4> [582.846655] hardirqs last enabled at (407499): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.846658] hardirqs last disabled at (407504): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.846660] softirqs last enabled at (406234): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.846662] softirqs last disabled at (406225): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.846664] ---[ end trace 0000000000000000 ]--- <7> [582.850064] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.850242] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.851061] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21304, lrc_seqno=21304, guc_id=0, flags=0x73 in no process [-1] <7> [582.851068] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.851183] ------------[ cut here ]------------ <4> [582.851185] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.851187] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#12: kworker/u64:30/6373 <4> [582.851305] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.851395] efi_pstore nfnetlink autofs4 <4> [582.851401] CPU: 12 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.851405] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.851407] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.851409] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.851416] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.851560] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.851563] RSP: 0000:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [582.851567] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.851570] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.851572] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.851574] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8882326cef40 <4> [582.851577] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.851579] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [582.851582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.851585] CR2: 00007023f08d5000 CR3: 000000010f4e4004 CR4: 0000000000f72ef0 <4> [582.851588] PKRU: 55555554 <4> [582.851590] Call Trace: <4> [582.851592] <TASK> <4> [582.851601] ? lock_acquire+0xc4/0x2c0 <4> [582.851608] ? find_held_lock+0x31/0x90 <4> [582.851615] ? lock_release+0xce/0x280 <4> [582.851627] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.851639] process_one_work+0x22e/0x6b0 <4> [582.851653] worker_thread+0x1e8/0x3d0 <4> [582.851659] ? __pfx_worker_thread+0x10/0x10 <4> [582.851663] kthread+0x11f/0x250 <4> [582.851669] ? __pfx_kthread+0x10/0x10 <4> [582.851676] ret_from_fork+0x344/0x3a0 <4> [582.851680] ? __pfx_kthread+0x10/0x10 <4> [582.851685] ret_from_fork_asm+0x1a/0x30 <4> [582.851704] </TASK> <4> [582.851706] irq event stamp: 252975 <4> [582.851708] hardirqs last enabled at (252981): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.851717] hardirqs last disabled at (252986): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.851720] softirqs last enabled at (252202): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.851725] softirqs last disabled at (252197): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.851729] ---[ end trace 0000000000000000 ]--- <6> [582.851732] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.851882] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.851896] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.851959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.853019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.853139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.853282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.853404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.853523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.853650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.853764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.853881] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.854007] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.854181] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.855669] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.866201] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.866578] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.868516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.868630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.868725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.868851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.868966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.869124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.869287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.869409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.869695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.869802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.870187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.870810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.870942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.871119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.871237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.871457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.871600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.871713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.871857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.871961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.872068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.872169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.872298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.872403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.872505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.872611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.872791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.873190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.873462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.873851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.874022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.874145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.874304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.874566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.874754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.874862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.874965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.875065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.875166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.875293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.875399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.875502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.875600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.875705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.875809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.875913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.876022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.876130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.876242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.876344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.876447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.876551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.876651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.876750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.876851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.876948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.877046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.877149] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.879317] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.882525] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21304, lrc_seqno=21304, guc_id=0, flags=0x73 in no process [-1] <7> [582.882531] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.882654] ------------[ cut here ]------------ <4> [582.882655] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.882657] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#12: kworker/u64:8/204 <4> [582.882766] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.882853] efi_pstore nfnetlink autofs4 <4> [582.882859] CPU: 12 UID: 0 PID: 204 Comm: kworker/u64:8 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.882863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.882864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.882866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.882874] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.882982] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.882984] RSP: 0000:ffffc900014cbca0 EFLAGS: 00010246 <4> [582.882987] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.882989] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.882990] RBP: ffffc900014cbda8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.882992] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8882326cef40 <4> [582.882993] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.882995] FS: 0000000000000000(0000) GS:ffff8888db2dd000(0000) knlGS:0000000000000000 <4> [582.882997] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.882999] CR2: 00007023f08d5000 CR3: 000000010f4e4004 CR4: 0000000000f72ef0 <4> [582.883001] PKRU: 55555554 <4> [582.883002] Call Trace: <4> [582.883004] <TASK> <4> [582.883010] ? lock_acquire+0xc4/0x2c0 <4> [582.883015] ? find_held_lock+0x31/0x90 <4> [582.883020] ? lock_release+0xce/0x280 <4> [582.883028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.883036] process_one_work+0x22e/0x6b0 <4> [582.883046] worker_thread+0x1e8/0x3d0 <4> [582.883050] ? __pfx_worker_thread+0x10/0x10 <4> [582.883053] kthread+0x11f/0x250 <4> [582.883057] ? __pfx_kthread+0x10/0x10 <4> [582.883062] ret_from_fork+0x344/0x3a0 <4> [582.883065] ? __pfx_kthread+0x10/0x10 <4> [582.883069] ret_from_fork_asm+0x1a/0x30 <4> [582.883082] </TASK> <4> [582.883083] irq event stamp: 2053133 <4> [582.883085] hardirqs last enabled at (2053139): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.883088] hardirqs last disabled at (2053144): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.883090] softirqs last enabled at (2052310): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.883094] softirqs last disabled at (2052219): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.883097] ---[ end trace 0000000000000000 ]--- <6> [582.883099] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.883218] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.883229] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.883398] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.883557] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.883717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.884827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.884969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.885115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.885296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.885443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.885576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.885714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.885847] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.885992] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.886185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.889783] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.900215] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.900627] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.903129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.903269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.903383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.903543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.903676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.903803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.903925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.904130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.904524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.904686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.904894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.905177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.905382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.905505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.905626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.905795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.905919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.906045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.906170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.906293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.906416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.906535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.906656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.906775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.906893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.907015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.907210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.907647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.908027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.908208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.908784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.908988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.909189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.909338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.909478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.909603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.909726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.909848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.909967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.910090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.910215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.910338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.910457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.910581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.910700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.910820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.910938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.911058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.911176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.911300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.911424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.911544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.911664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.911782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.911903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.912021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.912139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.912270] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.913600] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.914466] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21304, lrc_seqno=21304, guc_id=0, flags=0x73 in no process [-1] <7> [582.914469] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.914527] ------------[ cut here ]------------ <4> [582.914528] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.914529] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#5: kworker/u64:30/6373 <4> [582.914596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.914653] efi_pstore nfnetlink autofs4 <4> [582.914657] CPU: 5 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.914659] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.914660] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.914662] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.914666] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.914729] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.914730] RSP: 0018:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [582.914732] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.914733] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.914734] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.914735] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8882326cef40 <4> [582.914736] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.914737] FS: 0000000000000000(0000) GS:ffff8888daf5d000(0000) knlGS:0000000000000000 <4> [582.914739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.914740] CR2: 00007023f2915000 CR3: 0000000003448001 CR4: 0000000000f72ef0 <4> [582.914741] PKRU: 55555554 <4> [582.914742] Call Trace: <4> [582.914743] <TASK> <4> [582.914747] ? lock_acquire+0xc4/0x2c0 <4> [582.914751] ? find_held_lock+0x31/0x90 <4> [582.914753] ? lock_release+0xce/0x280 <4> [582.914758] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.914763] process_one_work+0x22e/0x6b0 <4> [582.914768] worker_thread+0x1e8/0x3d0 <4> [582.914771] ? __pfx_worker_thread+0x10/0x10 <4> [582.914773] kthread+0x11f/0x250 <4> [582.914776] ? __pfx_kthread+0x10/0x10 <4> [582.914779] ret_from_fork+0x344/0x3a0 <4> [582.914781] ? __pfx_kthread+0x10/0x10 <4> [582.914783] ret_from_fork_asm+0x1a/0x30 <4> [582.914790] </TASK> <4> [582.914791] irq event stamp: 264915 <4> [582.914792] hardirqs last enabled at (264921): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.914795] hardirqs last disabled at (264926): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.914797] softirqs last enabled at (263430): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.914799] softirqs last disabled at (263421): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.914801] ---[ end trace 0000000000000000 ]--- <7> [582.918067] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.918198] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [582.919123] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21374, lrc_seqno=21374, guc_id=0, flags=0x73 in no process [-1] <7> [582.919127] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.919190] ------------[ cut here ]------------ <4> [582.919191] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.919192] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#4: kworker/u64:30/6373 <4> [582.919319] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.919414] efi_pstore nfnetlink autofs4 <4> [582.919420] CPU: 4 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.919424] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.919426] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.919428] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.919437] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.919545] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.919548] RSP: 0018:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [582.919552] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.919554] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.919556] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.919558] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881215b3040 <4> [582.919560] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.919562] FS: 0000000000000000(0000) GS:ffff8888daedd000(0000) knlGS:0000000000000000 <4> [582.919564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.919566] CR2: 00007023ec2ad000 CR3: 0000000139ba8003 CR4: 0000000000f72ef0 <4> [582.919568] PKRU: 55555554 <4> [582.919570] Call Trace: <4> [582.919572] <TASK> <4> [582.919578] ? lock_acquire+0xc4/0x2c0 <4> [582.919584] ? find_held_lock+0x31/0x90 <4> [582.919590] ? lock_release+0xce/0x280 <4> [582.919597] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.919606] process_one_work+0x22e/0x6b0 <4> [582.919668] worker_thread+0x1e8/0x3d0 <4> [582.919671] ? __pfx_worker_thread+0x10/0x10 <4> [582.919673] kthread+0x11f/0x250 <4> [582.919676] ? __pfx_kthread+0x10/0x10 <4> [582.919680] ret_from_fork+0x344/0x3a0 <4> [582.919682] ? __pfx_kthread+0x10/0x10 <4> [582.919684] ret_from_fork_asm+0x1a/0x30 <4> [582.919692] </TASK> <4> [582.919693] irq event stamp: 268979 <4> [582.919694] hardirqs last enabled at (268985): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.919697] hardirqs last disabled at (268990): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.919699] softirqs last enabled at (268224): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.919701] softirqs last disabled at (268219): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.919704] ---[ end trace 0000000000000000 ]--- <6> [582.919706] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.919791] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.919803] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.920148] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <6> [582.920292] xe 0000:03:00.0: [drm] exec queue reset detected <6> [582.920324] xe 0000:03:00.0: [drm] exec queue reset detected <7> [582.921091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.921221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.921416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.921566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.921686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.921899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.922022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.922107] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.922225] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.922449] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.923807] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.934228] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.934684] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.937348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.937434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.937509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.937595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.937973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.938233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.938815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.939110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.939231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.939446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.940094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.940177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.940508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.940707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.941039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.941120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.941237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.941489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.941698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.941780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.941858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.941934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.942010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.942085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.942162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.942262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.943241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.943589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.943666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.944034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.944235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.944720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.944809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.945243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.945450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.945528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.945604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.945678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.945750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.945828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.945907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.945986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.946061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.946145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.946231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.946321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.946397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.946474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.946548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.946626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.946704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.946779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.946854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.946928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.947002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.947075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.947147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.947228] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.948487] xe 0000:03:00.0: [drm] exec queue reset detected <6> [582.948517] xe 0000:03:00.0: [drm] exec queue reset detected <6> [582.948694] xe 0000:03:00.0: [drm] exec queue reset detected <6> [582.948725] xe 0000:03:00.0: [drm] exec queue reset detected <6> [582.949408] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.950678] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21374, lrc_seqno=21374, guc_id=0, flags=0x73 in no process [-1] <7> [582.950681] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.950759] ------------[ cut here ]------------ <4> [582.950762] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.950763] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:30/6373 <4> [582.950843] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.950910] efi_pstore nfnetlink autofs4 <4> [582.950914] CPU: 8 UID: 0 PID: 6373 Comm: kworker/u64:30 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.950917] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.950918] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.950920] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.950925] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.950996] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.950997] RSP: 0018:ffffc9000a1d3ca0 EFLAGS: 00010246 <4> [582.950999] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.951001] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.951002] RBP: ffffc9000a1d3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.951003] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881215b3040 <4> [582.951004] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.951005] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [582.951007] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.951008] CR2: 00007023f2b85000 CR3: 00000001531e8002 CR4: 0000000000f72ef0 <4> [582.951009] PKRU: 55555554 <4> [582.951010] Call Trace: <4> [582.951011] <TASK> <4> [582.951015] ? lock_acquire+0xc4/0x2c0 <4> [582.951020] ? find_held_lock+0x31/0x90 <4> [582.951023] ? lock_release+0xce/0x280 <4> [582.951028] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.951034] process_one_work+0x22e/0x6b0 <4> [582.951040] worker_thread+0x1e8/0x3d0 <4> [582.951043] ? __pfx_worker_thread+0x10/0x10 <4> [582.951045] kthread+0x11f/0x250 <4> [582.951048] ? __pfx_kthread+0x10/0x10 <4> [582.951051] ret_from_fork+0x344/0x3a0 <4> [582.951055] ? __pfx_kthread+0x10/0x10 <4> [582.951057] ret_from_fork_asm+0x1a/0x30 <4> [582.951066] </TASK> <4> [582.951067] irq event stamp: 280205 <4> [582.951068] hardirqs last enabled at (280211): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.951071] hardirqs last disabled at (280216): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.951073] softirqs last enabled at (279382): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.951075] softirqs last disabled at (279377): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.951077] ---[ end trace 0000000000000000 ]--- <6> [582.951079] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.951151] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.951159] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.951185] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.951363] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.951484] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.952411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.952538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.952670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.952816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.952940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.953050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.953178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.953292] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.953370] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.953365] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.953364] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.953383] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.953386] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.953414] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.953648] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [582.955074] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [582.955082] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.955098] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.955141] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:200: IS_ERR(sync->ufence) <7> [582.965257] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [582.965634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [582.967161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [582.967293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [582.967387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [582.967486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [582.967583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [582.967673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [582.967763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [582.967855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [582.967948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [582.968042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [582.968132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [582.968223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [582.968434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [582.968527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [582.968618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [582.968714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [582.968874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [582.968964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [582.969056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [582.969157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [582.969332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [582.969456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [582.969572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [582.969663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [582.969753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [582.969852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [582.969960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [582.970056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [582.970149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [582.970251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [582.970371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [582.970505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [582.970651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [582.970755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [582.970858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [582.970962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [582.971058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [582.971152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [582.971252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [582.971349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [582.971443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [582.971539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [582.971638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [582.971740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [582.971835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [582.971929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [582.972044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [582.972139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [582.972229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [582.972369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [582.972480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [582.972583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [582.972699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [582.972795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [582.972889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [582.972982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [582.973074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [582.973168] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [582.979984] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [582.980893] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21374, lrc_seqno=21374, guc_id=0, flags=0x73 in no process [-1] <7> [582.980898] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.980988] ------------[ cut here ]------------ <4> [582.980990] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.980992] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:7/203 <4> [582.981074] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.981185] efi_pstore nfnetlink autofs4 <4> [582.981193] CPU: 8 UID: 0 PID: 203 Comm: kworker/u64:7 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.981198] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.981200] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.981203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.981211] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.981754] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.981757] RSP: 0018:ffffc900014c3ca0 EFLAGS: 00010246 <4> [582.981760] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.981762] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.981763] RBP: ffffc900014c3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.981765] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8881215b3040 <4> [582.981766] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.981767] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [582.981769] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.981771] CR2: 00007023f2b88828 CR3: 000000016733b005 CR4: 0000000000f72ef0 <4> [582.981773] PKRU: 55555554 <4> [582.981774] Call Trace: <4> [582.981775] <TASK> <4> [582.981781] ? lock_acquire+0xc4/0x2c0 <4> [582.981786] ? find_held_lock+0x31/0x90 <4> [582.981790] ? lock_release+0xce/0x280 <4> [582.981797] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.981804] process_one_work+0x22e/0x6b0 <4> [582.981814] worker_thread+0x1e8/0x3d0 <4> [582.981817] ? __pfx_worker_thread+0x10/0x10 <4> [582.981820] kthread+0x11f/0x250 <4> [582.981824] ? __pfx_kthread+0x10/0x10 <4> [582.981828] ret_from_fork+0x344/0x3a0 <4> [582.981831] ? __pfx_kthread+0x10/0x10 <4> [582.981834] ret_from_fork_asm+0x1a/0x30 <4> [582.981844] </TASK> <4> [582.981846] irq event stamp: 2138471 <4> [582.981847] hardirqs last enabled at (2138477): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.981851] hardirqs last disabled at (2138482): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.981853] softirqs last enabled at (2138302): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.981856] softirqs last disabled at (2137983): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.981859] ---[ end trace 0000000000000000 ]--- <7> [582.985285] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [582.985441] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [582.985579] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [582.986544] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [582.986708] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [582.986842] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [582.986966] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <5> [582.996198] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21444, lrc_seqno=21444, guc_id=0, flags=0x73 in no process [-1] <7> [582.996205] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [582.996372] ------------[ cut here ]------------ <4> [582.996374] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [582.996376] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#8: kworker/u64:7/203 <4> [582.996508] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [582.996598] efi_pstore nfnetlink autofs4 <4> [582.996605] CPU: 8 UID: 0 PID: 203 Comm: kworker/u64:7 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [582.996609] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [582.996610] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [582.996613] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [582.996620] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [582.996700] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [582.996703] RSP: 0018:ffffc900014c3ca0 EFLAGS: 00010246 <4> [582.996706] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [582.996707] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [582.996709] RBP: ffffc900014c3da8 R08: 0000000000000000 R09: 0000000000000000 <4> [582.996711] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1e040 <4> [582.996712] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [582.996714] FS: 0000000000000000(0000) GS:ffff8888db0dd000(0000) knlGS:0000000000000000 <4> [582.996716] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [582.996718] CR2: 00007023f2b88828 CR3: 0000000003448006 CR4: 0000000000f72ef0 <4> [582.996720] PKRU: 55555554 <4> [582.996721] Call Trace: <4> [582.996723] <TASK> <4> [582.996728] ? lock_acquire+0xc4/0x2c0 <4> [582.996734] ? find_held_lock+0x31/0x90 <4> [582.996739] ? lock_release+0xce/0x280 <4> [582.996746] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [582.996755] process_one_work+0x22e/0x6b0 <4> [582.996765] worker_thread+0x1e8/0x3d0 <4> [582.996769] ? __pfx_worker_thread+0x10/0x10 <4> [582.996772] kthread+0x11f/0x250 <4> [582.996777] ? __pfx_kthread+0x10/0x10 <4> [582.996782] ret_from_fork+0x344/0x3a0 <4> [582.996786] ? __pfx_kthread+0x10/0x10 <4> [582.996790] ret_from_fork_asm+0x1a/0x30 <4> [582.996801] </TASK> <4> [582.996803] irq event stamp: 2170145 <4> [582.996804] hardirqs last enabled at (2170151): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [582.996809] hardirqs last disabled at (2170156): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [582.996811] softirqs last enabled at (2169370): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.996815] softirqs last disabled at (2169337): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [582.996818] ---[ end trace 0000000000000000 ]--- <6> [582.996821] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [582.996944] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [582.996959] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [582.997382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [582.998231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [582.998376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [582.998514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [582.998646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [582.998777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [582.998905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [582.999035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [582.999164] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [582.999441] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [582.999658] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [583.001056] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <6> [583.007311] [IGT] xe_compute_preempt: finished subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE, FAIL <6> [583.008106] [IGT] xe_compute_preempt: finished subtest compute-preempt-many-vram-evict, FAIL <7> [583.011267] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [583.011636] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [583.014263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [583.014399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [583.014516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [583.014634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [583.014751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [583.014866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [583.014982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [583.015097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [583.015211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [583.015333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [583.015450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [583.015566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [583.015681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [583.015796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [583.015911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [583.016026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [583.016141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [583.016260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [583.016377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [583.016500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [583.016622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [583.016742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [583.016862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [583.016980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [583.017098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [583.017219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [583.017364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [583.017490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [583.017611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [583.017732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [583.017853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [583.017981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [583.018107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [583.018232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [583.018366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [583.018491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [583.018612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [583.018733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [583.018854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [583.018979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [583.019100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [583.019220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [583.019344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [583.019469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [583.019590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [583.019709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [583.019827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [583.019947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [583.020065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [583.020183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [583.020333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [583.020455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [583.020575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [583.020694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [583.020815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [583.020933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [583.021051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [583.021173] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [583.021923] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [583.023237] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21444, lrc_seqno=21444, guc_id=0, flags=0x73 in no process [-1] <7> [583.023242] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [583.032048] ------------[ cut here ]------------ <4> [583.032051] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [583.032054] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:19/2428 <4> [583.032202] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [583.032621] efi_pstore nfnetlink autofs4 <4> [583.032626] CPU: 10 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [583.032629] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [583.032630] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [583.032632] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [583.032637] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [583.032810] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [583.032813] RSP: 0000:ffffc9000371bca0 EFLAGS: 00010246 <4> [583.032816] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [583.032819] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [583.032821] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [583.032823] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1e040 <4> [583.032824] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [583.032826] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [583.032829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [583.032831] CR2: 00007023e9cdd000 CR3: 00000001531e8004 CR4: 0000000000f72ef0 <4> [583.032833] PKRU: 55555554 <4> [583.032835] Call Trace: <4> [583.032837] <TASK> <4> [583.032842] ? lock_acquire+0xc4/0x2c0 <4> [583.032847] ? find_held_lock+0x31/0x90 <4> [583.032850] ? lock_release+0xce/0x280 <4> [583.032855] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [583.032861] process_one_work+0x22e/0x6b0 <4> [583.032868] worker_thread+0x1e8/0x3d0 <4> [583.032871] ? __pfx_worker_thread+0x10/0x10 <4> [583.032873] kthread+0x11f/0x250 <4> [583.032876] ? __pfx_kthread+0x10/0x10 <4> [583.032879] ret_from_fork+0x344/0x3a0 <4> [583.032882] ? __pfx_kthread+0x10/0x10 <4> [583.032885] ret_from_fork_asm+0x1a/0x30 <4> [583.032893] </TASK> <4> [583.032894] irq event stamp: 687817 <4> [583.032895] hardirqs last enabled at (687823): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [583.032898] hardirqs last disabled at (687828): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [583.032900] softirqs last enabled at (687650): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [583.032903] softirqs last disabled at (687619): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [583.032905] ---[ end trace 0000000000000000 ]--- <6> [583.032907] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [583.032980] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [583.032998] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [583.033009] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [583.033109] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [583.033217] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [583.033755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [583.033885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [583.034019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [583.034148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440 <7> [583.034284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [583.034424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [583.034560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [583.034689] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [583.034826] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [583.035041] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [583.036095] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 45056) <7> [583.046279] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [583.046542] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [583.047865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [583.047941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [583.048015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [583.048090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [583.048165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [583.048239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [583.048325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [583.048398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [583.048470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [583.048541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [583.048616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [583.048688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [583.048761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [583.048833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [583.048904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [583.048975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [583.049046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [583.049115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [583.049186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [583.049265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [583.049424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [583.049547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [583.049655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x1000dafc <7> [583.049732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x1000db01 <7> [583.049808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x0000db1c <7> [583.049888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x7044] = 0x04200420 <7> [583.049967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [583.050043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [583.050122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [583.050202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [583.050287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [583.050372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [583.050454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [583.050537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000 <7> [583.050635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [583.050740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [583.050903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [583.051118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [583.051308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [583.051389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [583.051467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [583.051544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [583.051660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [583.051782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [583.051856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [583.051931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [583.052003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [583.052078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [583.052155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [583.052233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [583.052322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [583.052400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [583.052476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [583.052549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [583.052624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [583.052697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [583.052770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [583.052847] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [583.053466] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [583.054324] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21444, lrc_seqno=21444, guc_id=0, flags=0x73 in no process [-1] <7> [583.054327] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [583.054422] ------------[ cut here ]------------ <4> [583.054424] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [583.054425] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1563 at guc_exec_queue_timedout_job+0xe4a/0x2140 [xe], CPU#10: kworker/u64:19/2428 <4> [583.054501] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse <4> [583.054566] efi_pstore nfnetlink autofs4 <4> [583.054571] CPU: 10 UID: 0 PID: 2428 Comm: kworker/u64:19 Tainted: G S U W 6.19.0-rc5-lgci-xe-xe-4368-e9383891a008f23b4+ #1 PREEMPT(voluntary) <4> [583.054574] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [583.054575] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [583.054576] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [583.054581] RIP: 0010:guc_exec_queue_timedout_job+0xe57/0x2140 [xe] <4> [583.054649] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50 <4> [583.054651] RSP: 0000:ffffc9000371bca0 EFLAGS: 00010246 <4> [583.054653] RAX: ffffffffa11f64c7 RBX: ffff888166391a00 RCX: 0000000000000000 <4> [583.054654] RDX: ffff888104e18e10 RSI: ffffffffa11f64c7 RDI: ffffffffa1003f70 <4> [583.054655] RBP: ffffc9000371bda8 R08: 0000000000000000 R09: 0000000000000000 <4> [583.054657] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88816ea1e040 <4> [583.054658] R13: 0000000000000000 R14: 00000000ffffffc2 R15: ffff888104e18e10 <4> [583.054659] FS: 0000000000000000(0000) GS:ffff8888db1dd000(0000) knlGS:0000000000000000 <4> [583.054660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [583.054662] CR2: 00007023e9cdd000 CR3: 00000001531e8004 CR4: 0000000000f72ef0 <4> [583.054663] PKRU: 55555554 <4> [583.054664] Call Trace: <4> [583.054665] <TASK> <4> [583.054669] ? lock_acquire+0xc4/0x2c0 <4> [583.054674] ? find_held_lock+0x31/0x90 <4> [583.054678] ? lock_release+0xce/0x280 <4> [583.054683] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [583.054688] process_one_work+0x22e/0x6b0 <4> [583.054695] worker_thread+0x1e8/0x3d0 <4> [583.054697] ? __pfx_worker_thread+0x10/0x10 <4> [583.054699] kthread+0x11f/0x250 <4> [583.054703] ? __pfx_kthread+0x10/0x10 <4> [583.054706] ret_from_fork+0x344/0x3a0 <4> [583.054708] ? __pfx_kthread+0x10/0x10 <4> [583.054711] ret_from_fork_asm+0x1a/0x30 <4> [583.054719] </TASK> <4> [583.054720] irq event stamp: 694565 <4> [583.054721] hardirqs last enabled at (694571): [<ffffffff8149e009>] __up_console_sem+0x79/0xa0 <4> [583.054724] hardirqs last disabled at (694576): [<ffffffff8149dfee>] __up_console_sem+0x5e/0xa0 <4> [583.054726] softirqs last enabled at (692462): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [583.054729] softirqs last disabled at (692453): [<ffffffff813c96bf>] __irq_exit_rcu+0x13f/0x160 <4> [583.054731] ---[ end trace 0000000000000000 ]--- <7> [583.056436] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.056530] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.056992] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.057468] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.058284] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.058821] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [583.058956] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [583.059164] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.059256] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.059359] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [583.182441] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0 <6> [583.183048] [IGT] xe_compute_preempt: exiting, ret=98 <6> [583.199261] Console: switching to colour frame buffer device 240x67

<4> [581.814187] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.814442] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.858225] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.858380] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.883398] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.883563] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.889077] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.889328] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.912482] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.912659] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.936811] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.936957] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.942094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.942330] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.964003] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux

<4> [581.964087] intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [581.964242] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.986284] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.986432] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [581.993044] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [581.993283] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.015476] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.015681] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.038969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.039124] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.044679] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.044857] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.074538] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.074762] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.099137] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.099270] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.102409] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.102633] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.127677] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.127883] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.149751] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.149906] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.156791] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.157046] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.181603] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.181798] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.209019] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.209236] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.214983] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.215223] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.239959] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.240168] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.263891] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.264040] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.269234] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.269380] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.291735] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.291937] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.312787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.312944] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.318224] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.318445] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.343905] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.344065] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.365098] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp

<4> [582.365145] mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [582.365341] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.370768] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.371002] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.399750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.399894] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.420869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.421027] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.428571] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.428717] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.450471] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.450749] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.472105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.472251] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.480100] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.480349] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.503635] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.503783] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.525152] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.525299] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.531993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.532227] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.556371] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.556537] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.578778] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.578922] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.584248] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.584395] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.610826] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.611061] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.636185] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.636434] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.641555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.641701] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.669040] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.669199] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.697298] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad

<4> [582.697547] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.702764] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.702983] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.739409] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.739642] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.773309] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.773448] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.778568] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.778801] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.815428] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.815655] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.846457] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.846592] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.851305] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.851560] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.882766] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.882982] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.914596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.914729] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.919319] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.919545] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.950843] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.950996] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.981074] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.981754] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [582.996508] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [582.996700] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [583.032202] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [583.032810] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

<4> [583.054501] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_buddy drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_hdcp mei_pxp sparse_keymap mtd kvm_intel platform_profile wmi_bmof kvm snd_hda_intel usbhid irqbypass snd_intel_dspcfg ghash_clmulni_intel hid snd_hda_codec aesni_intel snd_hda_core rapl r8169 video snd_hwdep intel_cstate snd_pcm snd_timer binfmt_misc realtek i2c_i801 spi_intel_pci snd i2c_mux mei_me intel_pmc_core i2c_smbus soundcore spi_intel idma64 mei pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry pinctrl_alderlake acpi_pad wmi acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse

<4> [583.054649] Code: 85 ff 75 03 4c 8b 3f 44 89 85 78 ff ff ff e8 e0 15 5a e1 48 89 c6 48 8d 3d 56 ca 39 00 44 8b 85 78 ff ff ff 44 89 e9 4c 89 fa <67> 48 0f b9 3a 48 8b 43 58 e9 fc f3 ff ff 41 8b 47 08 49 8b 79 50

Results for igt@xe_compute_preempt@compute-preempt-many-vram-evict@engine-drm_xe_engine_class_compute