igt@xe_compute_preempt@compute-preempt-many-vram-evict on shard-bmg@xe-4919-3b9ca4c40814c96c38986ae2ba6651e43757ca5f Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-2
Igt-Version	IGT-Version: 2.4-g5b279a8b7 (x86_64) (Linux: 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ x86_64)
Out	Using IGT_SRANDOM=1776400635 for randomisation Opened device: /dev/dri/card0 Starting subtest: compute-preempt-many-vram-evict Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #2 ../lib/intel_compute.c:487 bo_execenv_sync() #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() #7 ../tests/intel/xe_compute_preempt.c:65 main() #8 [__libc_init_first+0x8a] #9 [__libc_start_main+0x8b] #10 [_start+0x25] Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (1.542s) Subtest compute-preempt-many-vram-evict: FAIL (1.543s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: compute-preempt-many-vram-evict Starting dynamic subtest: engine-DRM_XE_ENGINE_CLASS_COMPUTE (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: error: -5 != 0 Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. ** DEBUG (xe_compute_preempt:7500) DEBUG: VRAM: 12216, child count: 73 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7b83caeb6000, handle: 2, addr: 83e0000, size: 1000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7b83c89b0000, handle: 3, addr: 300000, size: 100000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7b83c89a0000, handle: 4, addr: 200000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7b83c8990000, handle: 5, addr: 63d0000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7b83c8980000, handle: 6, addr: 40000000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7b83c8970000, handle: 8, addr: 80000000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7b83c8870000, handle: 10, addr: 6000000, size: 100000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7b83c8860000, handle: 12, addr: 210000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7b83c8850000, handle: 13, addr: 100000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7b83c2450000, handle: 15, addr: 9000000, size: 6400000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7b83c2448000, handle: 148, addr: 107ff0000, size: 8000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 0 name: instr state base] data: 0x7b83cae12000, handle: 149, addr: 83e0000, size: 1000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 1 name: dynamic state base] data: 0x7b83c2348000, handle: 151, addr: 300000, size: 100000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 2 name: surface state base] data: 0x7b83c2338000, handle: 153, addr: 200000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 3 name: indirect object base] data: 0x7b83c2328000, handle: 154, addr: 63d0000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 4 name: addr input] data: 0x7b83c2318000, handle: 155, addr: 40000000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 5 name: addr output] data: 0x7b83c2308000, handle: 156, addr: 80000000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 6 name: general state base] data: 0x7b83c2208000, handle: 157, addr: 6000000, size: 100000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 7 name: binding table] data: 0x7b83c21f8000, handle: 163, addr: 210000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 8 name: batch] data: 0x7b83c21e8000, handle: 164, addr: 100000, size: 10000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 9 name: state context data base] data: 0x7b83bbde8000, handle: 169, addr: 9000000, size: 6400000 (xe_compute_preempt:7501) intel_compute-DEBUG: [i: 10 name: sip kernel] data: 0x7b83bbde0000, handle: 224, addr: 107ff0000, size: 8000 (xe_compute_preempt:7501) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:7501) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:7501) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:7501) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:7501) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:7501) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:7501) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:7501) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:7501) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:7501) intel_compute-DEBUG: general state base: 6000000 (xe_compute_preempt:7501) intel_compute-DEBUG: surface state base: 200000 (xe_compute_preempt:7501) intel_compute-DEBUG: dynamic state base: 300000 (xe_compute_preempt:7501) intel_compute-DEBUG: instruct base addr: 8000000 (xe_compute_preempt:7501) intel_compute-DEBUG: bindless base addr: 200000 (xe_compute_preempt:7501) intel_compute-DEBUG: state context data base addr: 9000000 (xe_compute_preempt:7501) intel_compute-DEBUG: offset indirect addr: 3d0000 (xe_compute_preempt:7501) intel_compute-DEBUG: kernel start pointer: 3e0000 (xe_compute_preempt:7501) intel_compute-DEBUG: sip start pointer: ffff0000 (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error (xe_compute_preempt:7501) xe/xe_ioctl-CRITICAL: error: -5 != 0 (xe_compute_preempt:7501) igt_core-INFO: Stack trace: (xe_compute_preempt:7501) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_compute_preempt:7501) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_compute_preempt:7501) igt_core-INFO: #2 ../lib/intel_compute.c:487 bo_execenv_sync() (xe_compute_preempt:7501) igt_core-INFO: #3 ../lib/intel_compute.c:2626 xe2lpg_compute_preempt_exec() (xe_compute_preempt:7501) igt_core-INFO: #4 ../lib/intel_compute.c:2955 run_intel_compute_kernel_preempt() (xe_compute_preempt:7501) igt_core-INFO: #5 ../tests/intel/xe_compute_preempt.c:58 test_compute_preempt() (xe_compute_preempt:7501) igt_core-INFO: #6 ../tests/intel/xe_compute_preempt.c:189 __igt_unique____real_main65() (xe_compute_preempt:7501) igt_core-INFO: #7 ../tests/intel/xe_compute_preempt.c:65 main() (xe_compute_preempt:7501) igt_core-INFO: #8 [__libc_init_first+0x8a] (xe_compute_preempt:7501) igt_core-INFO: #9 [__libc_start_main+0x8b] (xe_compute_preempt:7501) igt_core-INFO: #10 [_start+0x25] END Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE failed. DEBUG (xe_compute_preempt:7500) DEBUG: VRAM: 12216, child count: 73 END ** Dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE: FAIL (1.542s) Subtest compute-preempt-many-vram-evict: FAIL (1.543s)
Dmesg Scroll to first warning	<6> [279.606588] Console: switching to colour dummy device 80x25 <6> [279.606900] [IGT] xe_compute_preempt: executing <7> [279.876257] xe 0000:03:00.0: [drm:drm_pagemap_shrinker_scan [drm_gpusvm_helper]] Shrinking dpagemap ffff88812e2656d0. <6> [279.916960] [IGT] xe_compute_preempt: starting subtest compute-preempt-many-vram-evict <6> [279.917722] [IGT] xe_compute_preempt: starting dynamic subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE <6> [280.012712] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000000001790000 FaultType: 0 AccessType: 1 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [280.012732] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [280.012833] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <6> [280.016023] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [280.017574] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19490, lrc_seqno=19490, guc_id=0, flags=0x73 in no process [-1] <7> [280.017589] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.018114] ------------[ cut here ]------------ <4> [280.018122] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.018125] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:17/3450 <4> [280.018303] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.018435] autofs4 [last unloaded: snd_hda_intel] <4> [280.018444] CPU: 4 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.018452] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [280.018454] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.018457] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.018468] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.018605] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.018608] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.018612] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.018614] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.018616] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.018618] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.018619] R13: ffff888101c1f610 R14: ffff888129628000 R15: 00000000fffffffb <4> [280.018621] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [280.018623] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.018625] CR2: 00005adf763421c8 CR3: 000000012eb1e005 CR4: 0000000000f72ef0 <4> [280.018628] PKRU: 55555554 <4> [280.018630] Call Trace: <4> [280.018632] <TASK> <4> [280.018639] ? lock_sync+0x100/0x100 <4> [280.018649] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [280.018660] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.018673] process_one_work+0x239/0x760 <4> [280.018687] worker_thread+0x200/0x3f0 <4> [280.018707] ? __pfx_worker_thread+0x10/0x10 <4> [280.018711] kthread+0x10d/0x150 <4> [280.018716] ? __pfx_kthread+0x10/0x10 <4> [280.018721] ret_from_fork+0x3d4/0x480 <4> [280.018725] ? __pfx_kthread+0x10/0x10 <4> [280.018730] ret_from_fork_asm+0x1a/0x30 <4> [280.018746] </TASK> <4> [280.018751] irq event stamp: 450757 <4> [280.018754] hardirqs last enabled at (450763): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.018766] hardirqs last disabled at (450768): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.018769] softirqs last enabled at (450712): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.018774] softirqs last disabled at (450707): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.018781] ---[ end trace 0000000000000000 ]--- <6> [280.018786] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.018914] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.019276] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.019713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.022101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.022299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.022514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.022686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.023005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.023243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.023366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.023530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.024008] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.024231] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.024497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.026731] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.036792] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.037739] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.043877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.044031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.044138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.044768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.044985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.045738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.045933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.046154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.046738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.047322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.047550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.047752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.048732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.049727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.050421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.050638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.051644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.051828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.051952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.052064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.052217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.052366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.052476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.052581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.052687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.052870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.052995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.053109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.053273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.053386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.053736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.053927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.054101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.054799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.055732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.055903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.056013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.056159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.056269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.056376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.056485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.056636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.056803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.056960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.057070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.057176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.057280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.057395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.057509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.057614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.057798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.057916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.058057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.058165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.058272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.058386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.058487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.058589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.058779] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.060820] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.060829] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19490, lrc_seqno=19490, guc_id=0, flags=0x73 in no process [-1] <7> [280.060836] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.061004] ------------[ cut here ]------------ <4> [280.061007] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.061010] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:17/3450 <4> [280.061110] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.061265] autofs4 [last unloaded: snd_hda_intel] <4> [280.061272] CPU: 4 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.061277] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.061278] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.061281] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.061289] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.061468] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.061471] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.061476] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.061478] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.061480] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.061482] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.061483] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.061485] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [280.061487] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.061489] CR2: 00007b83c8ab0000 CR3: 000000012943d003 CR4: 0000000000f72ef0 <4> [280.061491] PKRU: 55555554 <4> [280.061493] Call Trace: <4> [280.061495] <TASK> <4> [280.061500] ? lock_sync+0x100/0x100 <4> [280.061510] ? lock_release+0xd0/0x2b0 <4> [280.061519] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.061529] process_one_work+0x239/0x760 <4> [280.061539] worker_thread+0x200/0x3f0 <4> [280.061543] ? __pfx_worker_thread+0x10/0x10 <4> [280.061547] kthread+0x10d/0x150 <4> [280.061552] ? __pfx_kthread+0x10/0x10 <4> [280.061559] ret_from_fork+0x3d4/0x480 <4> [280.061563] ? __pfx_kthread+0x10/0x10 <4> [280.061568] ret_from_fork_asm+0x1a/0x30 <4> [280.061581] </TASK> <4> [280.061582] irq event stamp: 455989 <4> [280.061585] hardirqs last enabled at (455995): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.061592] hardirqs last disabled at (456000): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.061596] softirqs last enabled at (455192): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.061601] softirqs last disabled at (455177): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.061605] ---[ end trace 0000000000000000 ]--- <6> [280.061608] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.061722] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.061733] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.061790] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.062670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.062809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.062935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.063061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.063182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.063313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.063437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.063557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.063675] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.063941] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.064126] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.065825] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.075706] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.076017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.077389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.077502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.077645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.077773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.077909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.078050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.078167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.078315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.078416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.078553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.078662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.078800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.078913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.079052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.079188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.079292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.079444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.079545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.079688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.079824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.079933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.080041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.080152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.080291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.080394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.080528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.080632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.080790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.080905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.081048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.081158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.081270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.081416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.081532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.081671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.081821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.081958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.082064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.082196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.082301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.082432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.082544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.082651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.082804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.082916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.083039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.083145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.083290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.083422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.083529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.083633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.083756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.083863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.083968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.084111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.084251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.084356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.084483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.084592] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.085349] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.085357] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19490, lrc_seqno=19490, guc_id=0, flags=0x73 in no process [-1] <7> [280.085362] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.085445] ------------[ cut here ]------------ <4> [280.085447] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.085450] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:17/3450 <4> [280.085583] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.085728] autofs4 [last unloaded: snd_hda_intel] <4> [280.085734] CPU: 4 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.085739] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.085741] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.085744] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.085752] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.085851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.085909] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.085914] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.085916] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.085918] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.085921] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.085923] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.085926] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [280.085929] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.085932] CR2: 000077330376c000 CR3: 000000012943d003 CR4: 0000000000f72ef0 <4> [280.085934] PKRU: 55555554 <4> [280.085936] Call Trace: <4> [280.085939] <TASK> <4> [280.085945] ? lock_sync+0x100/0x100 <4> [280.085955] ? lock_release+0xd0/0x2b0 <4> [280.085964] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.085973] process_one_work+0x239/0x760 <4> [280.085985] worker_thread+0x200/0x3f0 <4> [280.085990] ? __pfx_worker_thread+0x10/0x10 <4> [280.085994] kthread+0x10d/0x150 <4> [280.085999] ? __pfx_kthread+0x10/0x10 <4> [280.086005] ret_from_fork+0x3d4/0x480 <4> [280.086009] ? __pfx_kthread+0x10/0x10 <4> [280.086015] ret_from_fork_asm+0x1a/0x30 <4> [280.086026] </TASK> <4> [280.086028] irq event stamp: 461721 <4> [280.086031] hardirqs last enabled at (461727): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.086036] hardirqs last disabled at (461732): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.086040] softirqs last enabled at (459680): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.086044] softirqs last disabled at (459671): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.086047] ---[ end trace 0000000000000000 ]--- <7> [280.088186] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.088332] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.089572] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19520, lrc_seqno=19520, guc_id=0, flags=0x73 in no process [-1] <7> [280.089578] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.089669] ------------[ cut here ]------------ <4> [280.089671] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.089674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:17/3450 <4> [280.089796] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.089950] autofs4 [last unloaded: snd_hda_intel] <4> [280.089957] CPU: 4 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.089962] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.089965] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.089967] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.089976] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.090139] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.090142] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.090145] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.090147] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.090149] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.090152] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.090154] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.090157] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [280.090159] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.090162] CR2: 000077330376c000 CR3: 00000003a3a4e005 CR4: 0000000000f72ef0 <4> [280.090165] PKRU: 55555554 <4> [280.090167] Call Trace: <4> [280.090169] <TASK> <4> [280.090175] ? lock_sync+0x100/0x100 <4> [280.090184] ? lock_release+0xd0/0x2b0 <4> [280.090193] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.090201] process_one_work+0x239/0x760 <4> [280.090214] worker_thread+0x200/0x3f0 <4> [280.090219] ? __pfx_worker_thread+0x10/0x10 <4> [280.090223] kthread+0x10d/0x150 <4> [280.090227] ? __pfx_kthread+0x10/0x10 <4> [280.090233] ret_from_fork+0x3d4/0x480 <4> [280.090237] ? __pfx_kthread+0x10/0x10 <4> [280.090242] ret_from_fork_asm+0x1a/0x30 <4> [280.090255] </TASK> <4> [280.090257] irq event stamp: 463033 <4> [280.090258] hardirqs last enabled at (463039): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.090311] hardirqs last disabled at (463044): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.090315] softirqs last enabled at (461960): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.090319] softirqs last disabled at (461943): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.090323] ---[ end trace 0000000000000000 ]--- <6> [280.090326] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.090423] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.090433] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.090559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.091187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.091351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.091539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.091688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.091886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.092003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.092157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.092276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.092436] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.092590] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.092829] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.094146] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.104755] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.105033] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.106161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.106254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.106333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.106414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.106494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.106581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.106660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.106752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.106831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.106910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.106988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.107107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.107182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.107257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.107342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.107421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.107496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.107570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.107644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.107740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.107824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.107906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.107989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.108070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.108151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.108248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.108325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.108406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.108493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.108574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.108701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.108783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.108871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.108959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.109044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.109138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.109218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.109298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.109375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.109476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.109556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.109634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.109723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.109801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.109912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.109996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.110099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.110179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.110260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.110342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.110423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.110504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.110582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.110661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.110748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.110829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.110910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.110990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.111075] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.112034] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.112040] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19520, lrc_seqno=19520, guc_id=0, flags=0x73 in no process [-1] <7> [280.112043] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.112108] ------------[ cut here ]------------ <4> [280.112109] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.112111] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:17/3450 <4> [280.112183] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.112254] autofs4 [last unloaded: snd_hda_intel] <4> [280.112259] CPU: 8 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.112262] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.112263] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.112265] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.112271] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.112342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.112344] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.112346] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.112348] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.112349] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.112350] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.112351] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.112353] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.112354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.112356] CR2: 00007b83caef0428 CR3: 000000012943d003 CR4: 0000000000f72ef0 <4> [280.112357] PKRU: 55555554 <4> [280.112359] Call Trace: <4> [280.112360] <TASK> <4> [280.112364] ? lock_sync+0x100/0x100 <4> [280.112369] ? lock_release+0xd0/0x2b0 <4> [280.112375] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.112381] process_one_work+0x239/0x760 <4> [280.112388] worker_thread+0x200/0x3f0 <4> [280.112390] ? __pfx_worker_thread+0x10/0x10 <4> [280.112393] kthread+0x10d/0x150 <4> [280.112396] ? __pfx_kthread+0x10/0x10 <4> [280.112400] ret_from_fork+0x3d4/0x480 <4> [280.112402] ? __pfx_kthread+0x10/0x10 <4> [280.112406] ret_from_fork_asm+0x1a/0x30 <4> [280.112414] </TASK> <4> [280.112415] irq event stamp: 469381 <4> [280.112416] hardirqs last enabled at (469387): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.112419] hardirqs last disabled at (469392): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.112422] softirqs last enabled at (467408): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.112425] softirqs last disabled at (467401): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.112427] ---[ end trace 0000000000000000 ]--- <6> [280.112429] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.112500] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.112508] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.113718] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.113851] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.114111] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.114735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.114891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.115044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.115198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.115394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.115535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.115671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.115904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.116062] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.116209] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.116427] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.118096] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.128704] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.129039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.130159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.130319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.130441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.130564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.130687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.130816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.130939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.131061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.131183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.131303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.131425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.131548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.131671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.131802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.131928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.132049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.132173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.132298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.132424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.132555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.132686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.132823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.132954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.133081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.133207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.133335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.133460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.133588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.133726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.133861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.133992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.134121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.134253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.134390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.134525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.134655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.134797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.134929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.135058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.135185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.135316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.135449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.135581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.135716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.135854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.135982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.136113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.136241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.136370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.136495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.136621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.136756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.136886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.137015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.137144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.137274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.137398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.137525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.137656] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.139803] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.139811] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19520, lrc_seqno=19520, guc_id=0, flags=0x73 in no process [-1] <7> [280.139814] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.139888] ------------[ cut here ]------------ <4> [280.139889] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.139891] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:2/119 <4> [280.139969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.140042] autofs4 [last unloaded: snd_hda_intel] <4> [280.140046] CPU: 9 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.140050] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.140051] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.140053] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.140058] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.140131] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.140133] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.140136] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.140137] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.140138] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.140140] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.140141] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.140142] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [280.140144] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.140145] CR2: 00005adf76356040 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [280.140147] PKRU: 55555554 <4> [280.140148] Call Trace: <4> [280.140149] <TASK> <4> [280.140153] ? lock_sync+0x100/0x100 <4> [280.140159] ? lock_release+0xd0/0x2b0 <4> [280.140165] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.140171] process_one_work+0x239/0x760 <4> [280.140178] worker_thread+0x200/0x3f0 <4> [280.140180] ? __pfx_worker_thread+0x10/0x10 <4> [280.140183] kthread+0x10d/0x150 <4> [280.140186] ? __pfx_kthread+0x10/0x10 <4> [280.140190] ret_from_fork+0x3d4/0x480 <4> [280.140192] ? __pfx_kthread+0x10/0x10 <4> [280.140196] ret_from_fork_asm+0x1a/0x30 <4> [280.140204] </TASK> <4> [280.140205] irq event stamp: 424623 <4> [280.140206] hardirqs last enabled at (424629): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.140210] hardirqs last disabled at (424634): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.140212] softirqs last enabled at (423822): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.140215] softirqs last disabled at (423817): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.140217] ---[ end trace 0000000000000000 ]--- <7> [280.141448] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.141574] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.142580] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19562, lrc_seqno=19562, guc_id=0, flags=0x73 in no process [-1] <7> [280.142587] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.142699] ------------[ cut here ]------------ <4> [280.142702] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.142704] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:2/119 <4> [280.142815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.142951] autofs4 [last unloaded: snd_hda_intel] <4> [280.142958] CPU: 7 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.142963] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.142966] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.142968] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.142977] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.143084] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.143088] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.143092] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.143095] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.143098] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.143100] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.143102] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.143105] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [280.143108] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.143111] CR2: 00005adf76354f88 CR3: 0000000382898006 CR4: 0000000000f72ef0 <4> [280.143113] PKRU: 55555554 <4> [280.143116] Call Trace: <4> [280.143118] <TASK> <4> [280.143125] ? lock_sync+0x100/0x100 <4> [280.143135] ? lock_release+0xd0/0x2b0 <4> [280.143145] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.143155] process_one_work+0x239/0x760 <4> [280.143168] worker_thread+0x200/0x3f0 <4> [280.143173] ? __pfx_worker_thread+0x10/0x10 <4> [280.143177] kthread+0x10d/0x150 <4> [280.143182] ? __pfx_kthread+0x10/0x10 <4> [280.143189] ret_from_fork+0x3d4/0x480 <4> [280.143193] ? __pfx_kthread+0x10/0x10 <4> [280.143199] ret_from_fork_asm+0x1a/0x30 <4> [280.143213] </TASK> <4> [280.143215] irq event stamp: 426745 <4> [280.143217] hardirqs last enabled at (426751): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.143222] hardirqs last disabled at (426756): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.143227] softirqs last enabled at (425988): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.143231] softirqs last disabled at (425981): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.143235] ---[ end trace 0000000000000000 ]--- <6> [280.143239] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.143346] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.143365] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.143525] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.144262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.144443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.144590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.144741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.144879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.145015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.145152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.145334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.145469] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.145616] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.145841] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.147331] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.157705] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.158074] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.158930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.159014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.159092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.159171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.159248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.159325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.159401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.159478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.159556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.159653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.159741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.159818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.159893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.159970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.160046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.160120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.160194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.160268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.160342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.160425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.160508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.160590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.160673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.160765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.160844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.160922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.160999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.161080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.161161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.161242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.161323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.161406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.161495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.161581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.161669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.161769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.161853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.161932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.162010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.162089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.162170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.162249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.162327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.162405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.162492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.162575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.162657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.162747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.162830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.162910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.162988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.163070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.163149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.163230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.163311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.163393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.163472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.163550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.163630] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.164596] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.164602] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19562, lrc_seqno=19562, guc_id=0, flags=0x73 in no process [-1] <7> [280.164605] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.164672] ------------[ cut here ]------------ <4> [280.164674] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.164675] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [280.164777] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.164857] autofs4 [last unloaded: snd_hda_intel] <4> [280.164862] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.164865] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.164867] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.164869] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.164875] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.164947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.164950] RSP: 0000:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.164953] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.164954] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.164956] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.164957] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.164959] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.164960] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [280.164962] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.164964] CR2: 00007b83c8ab0000 CR3: 0000000129b7a006 CR4: 0000000000f72ef0 <4> [280.164965] PKRU: 55555554 <4> [280.164967] Call Trace: <4> [280.164968] <TASK> <4> [280.164973] ? lock_sync+0x100/0x100 <4> [280.164979] ? lock_release+0xd0/0x2b0 <4> [280.164985] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.164991] process_one_work+0x239/0x760 <4> [280.164998] worker_thread+0x200/0x3f0 <4> [280.165001] ? __pfx_worker_thread+0x10/0x10 <4> [280.165004] kthread+0x10d/0x150 <4> [280.165007] ? __pfx_kthread+0x10/0x10 <4> [280.165011] ret_from_fork+0x3d4/0x480 <4> [280.165014] ? __pfx_kthread+0x10/0x10 <4> [280.165018] ret_from_fork_asm+0x1a/0x30 <4> [280.165026] </TASK> <4> [280.165027] irq event stamp: 434699 <4> [280.165029] hardirqs last enabled at (434705): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.165032] hardirqs last disabled at (434710): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.165034] softirqs last enabled at (432214): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.165037] softirqs last disabled at (432207): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.165039] ---[ end trace 0000000000000000 ]--- <6> [280.165704] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.165895] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.165907] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.166102] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.166211] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.166322] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.166888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.167018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.167188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.167315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.167446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.167560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.167651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.167757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.167842] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.167968] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.168127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.169374] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.179701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.179968] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.180900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.181022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.181131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.181241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.181356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.181446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.181523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.181601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.181679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.181788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.181900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.182011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.182120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.182232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.182343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.182455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.182557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.182656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.182755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.182840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.182927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.183046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.183167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.183307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.183424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.183541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.183652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.183750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.183861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.183944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.184056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.184174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.184300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.184423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.184549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.184673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.184817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.184902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.184988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.185070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.185153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.185234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.185313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.185391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.185472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.185550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.185628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.185712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.185791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.185870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.185951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.186033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.186112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.186190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.186266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.186346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.186423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.186503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.186584] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.187666] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.187672] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19562, lrc_seqno=19562, guc_id=0, flags=0x73 in no process [-1] <7> [280.187675] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.188619] ------------[ cut here ]------------ <4> [280.188621] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.188623] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:15/3448 <4> [280.188707] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.188786] autofs4 [last unloaded: snd_hda_intel] <4> [280.188791] CPU: 2 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.188795] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.188797] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.188799] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.188805] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.188876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.188878] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.188881] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.188883] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.188884] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.188886] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.188887] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.188889] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.188891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.188893] CR2: 00005adf76354f88 CR3: 000000012943d001 CR4: 0000000000f72ef0 <4> [280.188895] PKRU: 55555554 <4> [280.188896] Call Trace: <4> [280.188898] <TASK> <4> [280.188902] ? lock_sync+0x100/0x100 <4> [280.188908] ? lock_release+0xd0/0x2b0 <4> [280.188914] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.188920] process_one_work+0x239/0x760 <4> [280.188928] worker_thread+0x200/0x3f0 <4> [280.188931] ? __pfx_worker_thread+0x10/0x10 <4> [280.188934] kthread+0x10d/0x150 <4> [280.188937] ? __pfx_kthread+0x10/0x10 <4> [280.188941] ret_from_fork+0x3d4/0x480 <4> [280.188944] ? __pfx_kthread+0x10/0x10 <4> [280.188948] ret_from_fork_asm+0x1a/0x30 <4> [280.188956] </TASK> <4> [280.188957] irq event stamp: 1389371 <4> [280.188959] hardirqs last enabled at (1389377): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.188962] hardirqs last disabled at (1389382): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.188964] softirqs last enabled at (1386672): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.188967] softirqs last disabled at (1386661): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.188970] ---[ end trace 0000000000000000 ]--- <7> [280.188987] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.189093] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.190211] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19617, lrc_seqno=19617, guc_id=0, flags=0x73 in no process [-1] <7> [280.190218] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.190338] ------------[ cut here ]------------ <4> [280.190340] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.190342] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:17/3450 <4> [280.190463] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.190577] autofs4 [last unloaded: snd_hda_intel] <4> [280.190583] CPU: 12 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.190588] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.190590] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.190593] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.190602] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.190729] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.190732] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.190736] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.190739] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.190742] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.190744] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.190746] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.190749] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [280.190751] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.190754] CR2: 00007b83c8ab0000 CR3: 0000000144d1d005 CR4: 0000000000f72ef0 <4> [280.190756] PKRU: 55555554 <4> [280.190758] Call Trace: <4> [280.190761] <TASK> <4> [280.190768] ? lock_sync+0x100/0x100 <4> [280.190776] ? lock_release+0xd0/0x2b0 <4> [280.190785] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.190795] process_one_work+0x239/0x760 <4> [280.190806] worker_thread+0x200/0x3f0 <4> [280.190811] ? __pfx_worker_thread+0x10/0x10 <4> [280.190815] kthread+0x10d/0x150 <4> [280.190819] ? __pfx_kthread+0x10/0x10 <4> [280.190825] ret_from_fork+0x3d4/0x480 <4> [280.190828] ? __pfx_kthread+0x10/0x10 <4> [280.190833] ret_from_fork_asm+0x1a/0x30 <4> [280.190846] </TASK> <4> [280.190847] irq event stamp: 475939 <4> [280.190849] hardirqs last enabled at (475945): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.190854] hardirqs last disabled at (475950): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.190857] softirqs last enabled at (473668): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [280.190861] softirqs last disabled at (473666): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [280.190864] ---[ end trace 0000000000000000 ]--- <6> [280.190867] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.190986] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.190995] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.191053] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.191771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.191913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.192055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.192196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.192332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.192480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.192620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.192764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.192897] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.193042] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.193215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.194908] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.205705] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.206039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.207102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.207229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.207350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.207513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.207607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.207701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.207808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.207886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.207991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.208067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.208147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.208224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.208302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.208412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.208490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.208569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.208644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.208727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.208802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.208886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.208971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.209052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.209135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.209217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.209310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.209389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.209468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.209549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.209630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.209717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.209796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.209914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.210000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.210084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.210174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.210260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.210365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.210446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.210527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.210606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.210686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.210782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.210863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.210959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.211044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.211125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.211206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.211286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.211367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.211475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.211552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.211637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.211729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.211814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.211897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.211978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.212057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.212137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.212221] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.213580] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.213587] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19617, lrc_seqno=19617, guc_id=0, flags=0x73 in no process [-1] <7> [280.213590] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.213665] ------------[ cut here ]------------ <4> [280.213666] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.213668] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:17/3450 <4> [280.213777] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.213851] autofs4 [last unloaded: snd_hda_intel] <4> [280.213856] CPU: 8 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.213859] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.213860] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.213862] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.213868] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.213940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.213942] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [280.213944] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.213946] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.213948] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.213949] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.213951] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.213952] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.213954] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.213956] CR2: 00007732f8064328 CR3: 0000000129b7a006 CR4: 0000000000f72ef0 <4> [280.213958] PKRU: 55555554 <4> [280.213959] Call Trace: <4> [280.213961] <TASK> <4> [280.213965] ? lock_sync+0x100/0x100 <4> [280.213971] ? lock_release+0xd0/0x2b0 <4> [280.213977] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.213983] process_one_work+0x239/0x760 <4> [280.213990] worker_thread+0x200/0x3f0 <4> [280.213993] ? __pfx_worker_thread+0x10/0x10 <4> [280.213996] kthread+0x10d/0x150 <4> [280.214000] ? __pfx_kthread+0x10/0x10 <4> [280.214003] ret_from_fork+0x3d4/0x480 <4> [280.214006] ? __pfx_kthread+0x10/0x10 <4> [280.214010] ret_from_fork_asm+0x1a/0x30 <4> [280.214018] </TASK> <4> [280.214020] irq event stamp: 485013 <4> [280.214021] hardirqs last enabled at (485019): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.214025] hardirqs last disabled at (485024): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.214028] softirqs last enabled at (482108): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.214031] softirqs last disabled at (482101): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.214033] ---[ end trace 0000000000000000 ]--- <6> [280.214036] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.214107] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.214116] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.215452] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.215564] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.216054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.217017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.217178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.217325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.217417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.217561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.217697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.217785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.217876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.217959] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.218084] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.218208] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.219864] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.229751] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.230029] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.230677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.230789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.230902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.231013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.231122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.231232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.231342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.231454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.231562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.231659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.231755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.231834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.231910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.231985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.232068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.232178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.232287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.232398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.232506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.232628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.232767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.232876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.232959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.233039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.233121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.233201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.233316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.233435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.233555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.233671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.233848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.233991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.234130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.234265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.234400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.234532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.234663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.234799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.234932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.235058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.235187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.235316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.235444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.235570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.235710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.235838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.235967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.236093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.236221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.236345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.236470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.236599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.236731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.236860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.236985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.237116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.237244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.237371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.237505] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.238807] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.238814] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19617, lrc_seqno=19617, guc_id=0, flags=0x73 in no process [-1] <7> [280.238818] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.238887] ------------[ cut here ]------------ <4> [280.238888] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.238890] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:6/205 <4> [280.238979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.239058] autofs4 [last unloaded: snd_hda_intel] <4> [280.239063] CPU: 11 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.239066] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.239067] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.239069] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.239075] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.239145] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.239147] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.239149] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.239151] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.239152] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.239153] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.239154] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.239156] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [280.239157] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.239159] CR2: 00005adf76356040 CR3: 00000001228d9003 CR4: 0000000000f72ef0 <4> [280.239160] PKRU: 55555554 <4> [280.239161] Call Trace: <4> [280.239163] <TASK> <4> [280.239167] ? lock_sync+0x100/0x100 <4> [280.239173] ? lock_release+0xd0/0x2b0 <4> [280.239179] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.239185] process_one_work+0x239/0x760 <4> [280.239192] worker_thread+0x200/0x3f0 <4> [280.239202] ? __pfx_worker_thread+0x10/0x10 <4> [280.239204] kthread+0x10d/0x150 <4> [280.239207] ? __pfx_kthread+0x10/0x10 <4> [280.239211] ret_from_fork+0x3d4/0x480 <4> [280.239214] ? __pfx_kthread+0x10/0x10 <4> [280.239217] ret_from_fork_asm+0x1a/0x30 <4> [280.239226] </TASK> <4> [280.239227] irq event stamp: 822595 <4> [280.239228] hardirqs last enabled at (822601): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.239231] hardirqs last disabled at (822606): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.239234] softirqs last enabled at (821610): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.239236] softirqs last disabled at (821605): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.239239] ---[ end trace 0000000000000000 ]--- <5> [280.242607] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=5, flags=0x0 in xe_compute_pree [7500] <7> [280.242612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [280.242765] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19672, lrc_seqno=19672, guc_id=0, flags=0x73 in no process [-1] <7> [280.242770] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.242882] ------------[ cut here ]------------ <4> [280.242885] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.242888] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:6/205 <4> [280.243027] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.243156] autofs4 [last unloaded: snd_hda_intel] <4> [280.243164] CPU: 11 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.243169] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.243171] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.243173] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.243182] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.243274] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.243276] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.243279] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.243280] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.243281] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.243283] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.243284] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.243285] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [280.243287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.243288] CR2: 00007b83c8a20000 CR3: 00000003704b5002 CR4: 0000000000f72ef0 <4> [280.243290] PKRU: 55555554 <4> [280.243291] Call Trace: <4> [280.243292] <TASK> <4> [280.243296] ? lock_sync+0x100/0x100 <4> [280.243302] ? lock_release+0xd0/0x2b0 <4> [280.243308] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.243321] process_one_work+0x239/0x760 <4> [280.243328] worker_thread+0x200/0x3f0 <4> [280.243331] ? __pfx_worker_thread+0x10/0x10 <4> [280.243333] kthread+0x10d/0x150 <4> [280.243337] ? __pfx_kthread+0x10/0x10 <4> [280.243340] ret_from_fork+0x3d4/0x480 <4> [280.243343] ? __pfx_kthread+0x10/0x10 <4> [280.243346] ret_from_fork_asm+0x1a/0x30 <4> [280.243354] </TASK> <4> [280.243355] irq event stamp: 824097 <4> [280.243357] hardirqs last enabled at (824103): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.243360] hardirqs last disabled at (824108): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.243362] softirqs last enabled at (823238): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.243365] softirqs last disabled at (823231): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.243367] ---[ end trace 0000000000000000 ]--- <6> [280.243369] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.243443] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.243449] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.243508] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.243615] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.244208] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.245329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.245473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.245614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.245779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.245913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.246058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.246194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.246336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.246469] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.246613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.246796] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.248306] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.258704] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.259035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.260181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.260306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.260426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.260548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.260670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.260815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.260938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.261059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.261180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.261300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.261422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.261543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.261663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.261791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.261913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.262034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.262155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.262276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.262396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.262523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.262649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.262787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.262884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.262970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.263054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.263137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.263218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.263301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.263384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.263464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.263544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.263625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.263723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.263811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.263898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.263980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.264061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.264139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.264217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.264292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.264373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.264450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.264528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.264606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.264686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.264784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.264866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.264946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.265027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.265106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.265183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.265264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.265341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.265419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.265499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.265582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.265660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.265748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.265830] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.267233] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.267239] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19672, lrc_seqno=19672, guc_id=0, flags=0x73 in no process [-1] <7> [280.267242] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.267303] ------------[ cut here ]------------ <4> [280.267305] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.267306] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:6/205 <4> [280.267378] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.267450] autofs4 [last unloaded: snd_hda_intel] <4> [280.267454] CPU: 4 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.267457] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.267459] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.267460] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.267466] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.267537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.267538] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.267541] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.267543] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.267544] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.267545] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.267546] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.267548] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [280.267549] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.267551] CR2: 00007b83c2438000 CR3: 0000000123a00003 CR4: 0000000000f72ef0 <4> [280.267552] PKRU: 55555554 <4> [280.267553] Call Trace: <4> [280.267554] <TASK> <4> [280.267559] ? lock_sync+0x100/0x100 <4> [280.267564] ? lock_release+0xd0/0x2b0 <4> [280.267570] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.267575] process_one_work+0x239/0x760 <4> [280.267582] worker_thread+0x200/0x3f0 <4> [280.267585] ? __pfx_worker_thread+0x10/0x10 <4> [280.267588] kthread+0x10d/0x150 <4> [280.267591] ? __pfx_kthread+0x10/0x10 <4> [280.267595] ret_from_fork+0x3d4/0x480 <4> [280.267598] ? __pfx_kthread+0x10/0x10 <4> [280.267601] ret_from_fork_asm+0x1a/0x30 <4> [280.267609] </TASK> <4> [280.267610] irq event stamp: 834545 <4> [280.267611] hardirqs last enabled at (834551): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.267614] hardirqs last disabled at (834556): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.267617] softirqs last enabled at (831182): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.267619] softirqs last disabled at (831173): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.267622] ---[ end trace 0000000000000000 ]--- <6> [280.267624] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.268579] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.268591] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.269060] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.269166] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.269275] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.269875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.269975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.270077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.270172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.270266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.270358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.270453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.270547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.270636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.270745] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.270867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.271881] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.281698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.281951] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.282970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.283054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.283135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.283216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.283297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.283379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.283460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.283540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.283619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.283702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.283782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.283860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.283939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.284019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.284097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.284176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.284254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.284333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.284410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.284499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.284587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.284672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.284767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.284850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.284932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.285015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.285098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.285182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.285267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.285350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.285434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.285519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.285613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.285711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.285803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.285893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.285985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.286072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.286157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.286240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.286327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.286411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.286497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.286582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.286672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.286777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.286862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.286946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.287031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.287113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.287194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.287280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.287362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.287446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.287528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.287612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.287701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.287786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.287873] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.289159] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.289164] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19672, lrc_seqno=19672, guc_id=0, flags=0x73 in no process [-1] <7> [280.289167] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.289227] ------------[ cut here ]------------ <4> [280.289228] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.289230] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:6/205 <4> [280.289301] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.289371] autofs4 [last unloaded: snd_hda_intel] <4> [280.289375] CPU: 8 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.289378] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.289380] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.289381] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.289387] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.289457] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.289459] RSP: 0000:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.289461] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.289463] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.289464] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.289465] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.289467] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.289468] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.289470] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.289471] CR2: 00007b83caef0428 CR3: 000000035208b004 CR4: 0000000000f72ef0 <4> [280.289472] PKRU: 55555554 <4> [280.289474] Call Trace: <4> [280.289475] <TASK> <4> [280.289479] ? lock_sync+0x100/0x100 <4> [280.289484] ? lock_release+0xd0/0x2b0 <4> [280.289490] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.289495] process_one_work+0x239/0x760 <4> [280.289502] worker_thread+0x200/0x3f0 <4> [280.289505] ? __pfx_worker_thread+0x10/0x10 <4> [280.289508] kthread+0x10d/0x150 <4> [280.289511] ? __pfx_kthread+0x10/0x10 <4> [280.289514] ret_from_fork+0x3d4/0x480 <4> [280.289517] ? __pfx_kthread+0x10/0x10 <4> [280.289520] ret_from_fork_asm+0x1a/0x30 <4> [280.289528] </TASK> <4> [280.289529] irq event stamp: 845331 <4> [280.289530] hardirqs last enabled at (845337): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.289534] hardirqs last disabled at (845342): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.289536] softirqs last enabled at (842146): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.289539] softirqs last disabled at (842139): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.289541] ---[ end trace 0000000000000000 ]--- <7> [280.290954] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.291332] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.292341] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19727, lrc_seqno=19727, guc_id=0, flags=0x73 in no process [-1] <7> [280.292350] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.292500] ------------[ cut here ]------------ <4> [280.292502] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.292505] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#15: kworker/u64:20/3453 <4> [280.292664] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.292814] autofs4 [last unloaded: snd_hda_intel] <4> [280.292823] CPU: 15 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.292829] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.292832] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.292835] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.292848] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.292999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.293003] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [280.293008] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.293011] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.293014] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.293016] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.293019] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.293022] FS: 0000000000000000(0000) GS:ffff8888db417000(0000) knlGS:0000000000000000 <4> [280.293025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.293028] CR2: 00007b83c8990000 CR3: 000000012eaec003 CR4: 0000000000f72ef0 <4> [280.293030] PKRU: 55555554 <4> [280.293033] Call Trace: <4> [280.293035] <TASK> <4> [280.293043] ? lock_sync+0x100/0x100 <4> [280.293054] ? lock_release+0xd0/0x2b0 <4> [280.293065] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.293077] process_one_work+0x239/0x760 <4> [280.293090] worker_thread+0x200/0x3f0 <4> [280.293096] ? __pfx_worker_thread+0x10/0x10 <4> [280.293100] kthread+0x10d/0x150 <4> [280.293106] ? __pfx_kthread+0x10/0x10 <4> [280.293112] ret_from_fork+0x3d4/0x480 <4> [280.293117] ? __pfx_kthread+0x10/0x10 <4> [280.293123] ret_from_fork_asm+0x1a/0x30 <4> [280.293139] </TASK> <4> [280.293141] irq event stamp: 260613 <4> [280.293143] hardirqs last enabled at (260619): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.293148] hardirqs last disabled at (260624): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.293152] softirqs last enabled at (256952): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [280.293157] softirqs last disabled at (256950): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [280.293161] ---[ end trace 0000000000000000 ]--- <6> [280.293165] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.293314] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.293356] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.293419] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.294448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.294621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.294817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.294982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.295139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.295285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.295421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.295558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.295697] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.295844] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.296011] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.297373] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.307700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.308015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.309205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.309329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.309448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.309570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.309711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.309834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.309956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.310077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.310197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.310318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.310439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.310560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.310681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.310808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.310930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.311051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.311172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.311292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.311413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.311538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.311664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.311811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.311906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.311990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.312071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.312151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.312231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.312313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.312400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.312483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.312564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.312644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.312741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.312826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.312910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.312991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.313072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.313151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.313228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.313304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.313384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.313461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.313539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.313619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.313709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.313817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.313898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.313975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.314053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.314130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.314209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.314293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.314372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.314452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.314530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.314609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.314684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.314779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.314899] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.316225] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.316231] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19727, lrc_seqno=19727, guc_id=0, flags=0x73 in no process [-1] <7> [280.316234] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.316296] ------------[ cut here ]------------ <4> [280.316297] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.316298] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:20/3453 <4> [280.316372] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.316441] autofs4 [last unloaded: snd_hda_intel] <4> [280.316445] CPU: 8 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.316448] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.316449] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.316451] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.316456] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.316527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.316529] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [280.316531] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.316533] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.316534] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.316535] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.316537] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.316538] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.316539] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.316541] CR2: 00007b83c8990000 CR3: 000000012943d006 CR4: 0000000000f72ef0 <4> [280.316542] PKRU: 55555554 <4> [280.316544] Call Trace: <4> [280.316545] <TASK> <4> [280.316549] ? lock_sync+0x100/0x100 <4> [280.316554] ? lock_release+0xd0/0x2b0 <4> [280.316560] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.316565] process_one_work+0x239/0x760 <4> [280.316572] worker_thread+0x200/0x3f0 <4> [280.316575] ? __pfx_worker_thread+0x10/0x10 <4> [280.316577] kthread+0x10d/0x150 <4> [280.316580] ? __pfx_kthread+0x10/0x10 <4> [280.316584] ret_from_fork+0x3d4/0x480 <4> [280.316586] ? __pfx_kthread+0x10/0x10 <4> [280.316590] ret_from_fork_asm+0x1a/0x30 <4> [280.316597] </TASK> <4> [280.316598] irq event stamp: 271369 <4> [280.316600] hardirqs last enabled at (271375): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.316603] hardirqs last disabled at (271380): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.316605] softirqs last enabled at (268184): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.316608] softirqs last disabled at (268179): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.316610] ---[ end trace 0000000000000000 ]--- <6> [280.316612] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.316683] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.316697] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.317109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.317681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.317821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.317915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.318006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.318094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.318181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.318267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.318353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.318434] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.318529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.318647] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.319663] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.329697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.329948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.330971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.331052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.331129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.331207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.331285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.331362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.331441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.331520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.331597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.331673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.331760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.331835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.331908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.331984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.332059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.332133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.332208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.332280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.332353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.332436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.332521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.332603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.332683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.332776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.332854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.332931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.333008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.333091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.333175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.333255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.333333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.333414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.333499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.333584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.333669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.333764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.333850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.333931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.334010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.334088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.334168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.334247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.334325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.334407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.334493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.334571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.334652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.334743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.334823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.334899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.334976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.335056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.335134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.335211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.335287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.335370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.335451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.335530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.335611] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.336822] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.336827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19727, lrc_seqno=19727, guc_id=0, flags=0x73 in no process [-1] <7> [280.336830] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.336890] ------------[ cut here ]------------ <4> [280.336891] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.336892] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:20/3453 <4> [280.336964] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.337030] autofs4 [last unloaded: snd_hda_intel] <4> [280.337034] CPU: 8 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.337036] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.337038] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.337039] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.337044] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.337114] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.337116] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [280.337118] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.337119] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.337121] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.337122] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.337123] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.337125] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.337126] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.337127] CR2: 00007b83c8990000 CR3: 000000012943d006 CR4: 0000000000f72ef0 <4> [280.337129] PKRU: 55555554 <4> [280.337130] Call Trace: <4> [280.337131] <TASK> <4> [280.337135] ? lock_sync+0x100/0x100 <4> [280.337140] ? lock_release+0xd0/0x2b0 <4> [280.337145] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.337151] process_one_work+0x239/0x760 <4> [280.337157] worker_thread+0x200/0x3f0 <4> [280.337160] ? __pfx_worker_thread+0x10/0x10 <4> [280.337162] kthread+0x10d/0x150 <4> [280.337165] ? __pfx_kthread+0x10/0x10 <4> [280.337169] ret_from_fork+0x3d4/0x480 <4> [280.337171] ? __pfx_kthread+0x10/0x10 <4> [280.337174] ret_from_fork_asm+0x1a/0x30 <4> [280.337182] </TASK> <4> [280.337183] irq event stamp: 282219 <4> [280.337184] hardirqs last enabled at (282225): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.337187] hardirqs last disabled at (282230): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.337189] softirqs last enabled at (279092): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.337192] softirqs last disabled at (279085): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.337194] ---[ end trace 0000000000000000 ]--- <7> [280.339750] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.339905] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.340043] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19782, lrc_seqno=19782, guc_id=0, flags=0x73 in no process [-1] <7> [280.340047] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.340115] ------------[ cut here ]------------ <4> [280.340117] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.340119] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:20/3453 <4> [280.340196] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.340299] autofs4 [last unloaded: snd_hda_intel] <4> [280.340305] CPU: 8 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.340308] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.340310] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.340312] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.340318] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.340400] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.340402] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [280.340405] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.340407] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.340408] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.340410] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.340411] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.340413] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.340415] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.340417] CR2: 00007b83c2328000 CR3: 000000011d0aa003 CR4: 0000000000f72ef0 <4> [280.340418] PKRU: 55555554 <4> [280.340420] Call Trace: <4> [280.340421] <TASK> <4> [280.340426] ? lock_sync+0x100/0x100 <4> [280.340432] ? lock_release+0xd0/0x2b0 <4> [280.340440] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.340446] process_one_work+0x239/0x760 <4> [280.340454] worker_thread+0x200/0x3f0 <4> [280.340458] ? __pfx_worker_thread+0x10/0x10 <4> [280.340461] kthread+0x10d/0x150 <4> [280.340464] ? __pfx_kthread+0x10/0x10 <4> [280.340469] ret_from_fork+0x3d4/0x480 <4> [280.340471] ? __pfx_kthread+0x10/0x10 <4> [280.340475] ret_from_fork_asm+0x1a/0x30 <4> [280.340485] </TASK> <4> [280.340486] irq event stamp: 283469 <4> [280.340488] hardirqs last enabled at (283475): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.340491] hardirqs last disabled at (283480): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.340494] softirqs last enabled at (279092): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.340497] softirqs last disabled at (279085): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.340500] ---[ end trace 0000000000000000 ]--- <6> [280.340502] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.340580] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.340588] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.340854] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.344319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.344449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.344546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.344637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.344760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.344887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.345015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.345140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.345262] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.345399] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.345558] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.346639] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.356698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.356956] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.357990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.358073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.358151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.358230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.358307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.358385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.358461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.358539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.358618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.358705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.358783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.358859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.358935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.359010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.359084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.359159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.359234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.359309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.359384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.359468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.359550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.359633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.359722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.359803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.359881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.359959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.360037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.360117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.360198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.360277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.360356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.360435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.360519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.360603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.360687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.360786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.360871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.360952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.361032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.361110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.361192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.361270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.361349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.361429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.361512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.361591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.361669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.361756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.361835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.361911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.361987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.362066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.362142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.362219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.362295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.362372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.362447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.362524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.362604] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.363930] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.363938] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19782, lrc_seqno=19782, guc_id=0, flags=0x73 in no process [-1] <7> [280.363941] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.364009] ------------[ cut here ]------------ <4> [280.364010] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.364012] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:20/3453 <4> [280.364087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.364158] autofs4 [last unloaded: snd_hda_intel] <4> [280.364162] CPU: 2 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.364165] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.364167] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.364169] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.364174] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.364245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.364247] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [280.364250] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.364251] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.364252] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.364254] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.364255] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.364256] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.364258] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.364259] CR2: 00007b83c8860000 CR3: 00000001240fe005 CR4: 0000000000f72ef0 <4> [280.364261] PKRU: 55555554 <4> [280.364262] Call Trace: <4> [280.364263] <TASK> <4> [280.364267] ? lock_sync+0x100/0x100 <4> [280.364273] ? lock_release+0xd0/0x2b0 <4> [280.364278] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.364284] process_one_work+0x239/0x760 <4> [280.364291] worker_thread+0x200/0x3f0 <4> [280.364293] ? __pfx_worker_thread+0x10/0x10 <4> [280.364296] kthread+0x10d/0x150 <4> [280.364299] ? __pfx_kthread+0x10/0x10 <4> [280.364303] ret_from_fork+0x3d4/0x480 <4> [280.364305] ? __pfx_kthread+0x10/0x10 <4> [280.364309] ret_from_fork_asm+0x1a/0x30 <4> [280.364316] </TASK> <4> [280.364318] irq event stamp: 294253 <4> [280.364319] hardirqs last enabled at (294259): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.364322] hardirqs last disabled at (294264): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.364324] softirqs last enabled at (290712): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.364327] softirqs last disabled at (290703): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.364330] ---[ end trace 0000000000000000 ]--- <6> [280.364332] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.364402] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.364409] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.365748] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.365857] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.365965] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.366544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.366635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.366739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.366830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.366920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.367006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.367093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.367182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.367269] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.367365] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.367486] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.368512] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.378764] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.379018] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.380041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.380121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.380198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.380277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.380356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.380436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.380513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.380588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.380663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.380749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.380823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.380897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.380970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.381044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.381117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.381191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.381265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.381339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.381413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.381495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.381576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.381657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.381748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.381831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.381911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.381989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.382067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.382148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.382228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.382305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.382383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.382462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.382547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.382630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.382717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.382799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.382882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.382963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.383043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.383120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.383200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.383279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.383357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.383433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.383514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.383590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.383667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.383754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.383832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.383908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.383984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.384064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.384141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.384218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.384295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.384373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.384448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.384525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.384608] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.385819] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.385823] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19782, lrc_seqno=19782, guc_id=0, flags=0x73 in no process [-1] <7> [280.385826] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.385886] ------------[ cut here ]------------ <4> [280.385887] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.385888] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:20/3453 <4> [280.385960] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.386029] autofs4 [last unloaded: snd_hda_intel] <4> [280.386033] CPU: 2 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.386036] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.386037] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.386039] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.386044] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.386115] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.386117] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [280.386119] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.386120] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.386122] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.386123] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.386124] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.386125] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.386127] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.386128] CR2: 00007b83c8860000 CR3: 00000001240fe005 CR4: 0000000000f72ef0 <4> [280.386130] PKRU: 55555554 <4> [280.386131] Call Trace: <4> [280.386132] <TASK> <4> [280.386136] ? lock_sync+0x100/0x100 <4> [280.386142] ? lock_release+0xd0/0x2b0 <4> [280.386147] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.386153] process_one_work+0x239/0x760 <4> [280.386160] worker_thread+0x200/0x3f0 <4> [280.386162] ? __pfx_worker_thread+0x10/0x10 <4> [280.386165] kthread+0x10d/0x150 <4> [280.386168] ? __pfx_kthread+0x10/0x10 <4> [280.386172] ret_from_fork+0x3d4/0x480 <4> [280.386174] ? __pfx_kthread+0x10/0x10 <4> [280.386177] ret_from_fork_asm+0x1a/0x30 <4> [280.386185] </TASK> <4> [280.386186] irq event stamp: 304957 <4> [280.386188] hardirqs last enabled at (304963): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.386191] hardirqs last disabled at (304968): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.386193] softirqs last enabled at (301824): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.386195] softirqs last disabled at (301817): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.386198] ---[ end trace 0000000000000000 ]--- <7> [280.388764] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.388920] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.389715] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19837, lrc_seqno=19837, guc_id=0, flags=0x73 in no process [-1] <7> [280.389723] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.389840] ------------[ cut here ]------------ <4> [280.389842] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.389845] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:16/3449 <4> [280.389971] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.390069] autofs4 [last unloaded: snd_hda_intel] <4> [280.390076] CPU: 13 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.390080] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.390082] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.390084] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.390093] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.390216] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.390218] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.390222] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.390224] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.390226] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.390228] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.390230] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.390232] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000 <4> [280.390234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.390236] CR2: 00007b83c2328000 CR3: 000000038685b001 CR4: 0000000000f72ef0 <4> [280.390238] PKRU: 55555554 <4> [280.390240] Call Trace: <4> [280.390242] <TASK> <4> [280.390248] ? lock_sync+0x100/0x100 <4> [280.390256] ? lock_release+0xd0/0x2b0 <4> [280.390265] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.390275] process_one_work+0x239/0x760 <4> [280.390286] worker_thread+0x200/0x3f0 <4> [280.390290] ? __pfx_worker_thread+0x10/0x10 <4> [280.390293] kthread+0x10d/0x150 <4> [280.390298] ? __pfx_kthread+0x10/0x10 <4> [280.390303] ret_from_fork+0x3d4/0x480 <4> [280.390306] ? __pfx_kthread+0x10/0x10 <4> [280.390311] ret_from_fork_asm+0x1a/0x30 <4> [280.390324] </TASK> <4> [280.390326] irq event stamp: 480719 <4> [280.390328] hardirqs last enabled at (480725): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.390332] hardirqs last disabled at (480730): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.390335] softirqs last enabled at (479876): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.390339] softirqs last disabled at (479863): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.390342] ---[ end trace 0000000000000000 ]--- <6> [280.390345] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.390463] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.390473] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.390524] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.391373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.391515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.391655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.391799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.391935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.392069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.392204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.392338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.392472] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.392619] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.392816] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.394200] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.404699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.404956] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.405964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.406046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.406126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.406205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.406283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.406360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.406435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.406511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.406587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.406661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.406751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.406825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.406899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.406974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.407048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.407123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.407200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.407275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.407351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.407434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.407515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.407594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.407676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.407784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.407864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.407942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.408021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.408102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.408184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.408264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.408345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.408428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.408518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.408606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.408697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.408780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.408861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.408940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.409019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.409100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.409184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.409265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.409345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.409422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.409504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.409582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.409660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.409748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.409827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.409904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.409980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.410060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.410138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.410215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.410294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.410377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.410456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.410533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.410614] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.411870] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.411875] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19837, lrc_seqno=19837, guc_id=0, flags=0x73 in no process [-1] <7> [280.411878] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.411940] ------------[ cut here ]------------ <4> [280.411941] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.411943] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3449 <4> [280.412016] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.412085] autofs4 [last unloaded: snd_hda_intel] <4> [280.412090] CPU: 8 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.412093] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.412094] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.412095] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.412101] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.412171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.412172] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.412175] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.412176] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.412177] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.412179] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.412180] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.412181] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.412183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.412184] CR2: 00007b83c8990000 CR3: 000000012943d002 CR4: 0000000000f72ef0 <4> [280.412186] PKRU: 55555554 <4> [280.412187] Call Trace: <4> [280.412188] <TASK> <4> [280.412192] ? lock_sync+0x100/0x100 <4> [280.412197] ? lock_release+0xd0/0x2b0 <4> [280.412202] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.412208] process_one_work+0x239/0x760 <4> [280.412215] worker_thread+0x200/0x3f0 <4> [280.412218] ? __pfx_worker_thread+0x10/0x10 <4> [280.412220] kthread+0x10d/0x150 <4> [280.412223] ? __pfx_kthread+0x10/0x10 <4> [280.412227] ret_from_fork+0x3d4/0x480 <4> [280.412229] ? __pfx_kthread+0x10/0x10 <4> [280.412233] ret_from_fork_asm+0x1a/0x30 <4> [280.412240] </TASK> <4> [280.412241] irq event stamp: 491625 <4> [280.412243] hardirqs last enabled at (491631): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.412246] hardirqs last disabled at (491636): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.412248] softirqs last enabled at (488380): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.412251] softirqs last disabled at (488373): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.412253] ---[ end trace 0000000000000000 ]--- <6> [280.412255] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.412326] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.412332] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.413631] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.413750] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.413860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.414433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.414523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.414616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.414714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.414806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.414896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.414984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.415074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.415159] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.415255] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.415371] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.416383] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.426699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.426952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.427961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.428040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.428118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.428197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.428275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.428351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.428427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.428503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.428579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.428655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.428746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.428824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.428900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.428976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.429050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.429124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.429198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.429273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.429347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.429430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.429513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.429594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.429678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.429776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.429855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.429932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.430010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.430091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.430172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.430250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.430330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.430410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.430495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.430582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.430670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.430765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.430848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.430928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.431007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.431084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.431165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.431244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.431322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.431400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.431480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.431557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.431636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.431720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.431799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.431874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.431954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.432039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.432118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.432197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.432274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.432353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.432430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.432507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.432588] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.433783] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.433787] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19837, lrc_seqno=19837, guc_id=0, flags=0x73 in no process [-1] <7> [280.433790] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.433851] ------------[ cut here ]------------ <4> [280.433853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.433854] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3449 <4> [280.433928] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.434010] autofs4 [last unloaded: snd_hda_intel] <4> [280.434014] CPU: 8 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.434017] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.434019] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.434021] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.434026] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.434097] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.434099] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.434101] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.434102] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.434104] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.434105] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.434106] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.434108] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.434109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.434111] CR2: 00007b83c8990000 CR3: 000000012943d002 CR4: 0000000000f72ef0 <4> [280.434112] PKRU: 55555554 <4> [280.434113] Call Trace: <4> [280.434114] <TASK> <4> [280.434118] ? lock_sync+0x100/0x100 <4> [280.434123] ? lock_release+0xd0/0x2b0 <4> [280.434128] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.434134] process_one_work+0x239/0x760 <4> [280.434141] worker_thread+0x200/0x3f0 <4> [280.434144] ? __pfx_worker_thread+0x10/0x10 <4> [280.434146] kthread+0x10d/0x150 <4> [280.434149] ? __pfx_kthread+0x10/0x10 <4> [280.434153] ret_from_fork+0x3d4/0x480 <4> [280.434155] ? __pfx_kthread+0x10/0x10 <4> [280.434158] ret_from_fork_asm+0x1a/0x30 <4> [280.434166] </TASK> <4> [280.434167] irq event stamp: 502281 <4> [280.434168] hardirqs last enabled at (502287): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.434171] hardirqs last disabled at (502292): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.434173] softirqs last enabled at (501364): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.434176] softirqs last disabled at (501359): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.434178] ---[ end trace 0000000000000000 ]--- <5> [280.436389] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19892, lrc_seqno=19892, guc_id=0, flags=0x73 in no process [-1] <7> [280.436398] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [280.436393] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [280.436515] ------------[ cut here ]------------ <4> [280.436517] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.436519] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:16/3449 <7> [280.436543] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [280.436640] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.436763] autofs4 [last unloaded: snd_hda_intel] <4> [280.436769] CPU: 13 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.436774] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.436776] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.436778] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.436788] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.436906] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.436908] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.436911] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.436914] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.436916] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.436917] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.436919] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.436921] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000 <4> [280.436924] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.436926] CR2: 00005adf763421c8 CR3: 000000015e787005 CR4: 0000000000f72ef0 <4> [280.436928] PKRU: 55555554 <4> [280.436929] Call Trace: <4> [280.436931] <TASK> <4> [280.436938] ? lock_sync+0x100/0x100 <4> [280.436946] ? lock_release+0xd0/0x2b0 <4> [280.436954] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.436963] process_one_work+0x239/0x760 <4> [280.436973] worker_thread+0x200/0x3f0 <4> [280.436978] ? __pfx_worker_thread+0x10/0x10 <4> [280.436981] kthread+0x10d/0x150 <4> [280.436985] ? __pfx_kthread+0x10/0x10 <4> [280.436990] ret_from_fork+0x3d4/0x480 <4> [280.436993] ? __pfx_kthread+0x10/0x10 <4> [280.436998] ret_from_fork_asm+0x1a/0x30 <4> [280.437010] </TASK> <4> [280.437012] irq event stamp: 503479 <4> [280.437014] hardirqs last enabled at (503485): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.437018] hardirqs last disabled at (503490): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.437021] softirqs last enabled at (502944): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.437025] softirqs last disabled at (502939): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.437028] ---[ end trace 0000000000000000 ]--- <6> [280.437031] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.437149] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.437161] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.437221] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.438096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.438234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.438375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.438516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.438652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.438798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.438934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.439072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.439204] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.439348] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.439522] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.441122] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.451700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.452029] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.453264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.453396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.453519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.453642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.453784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.453908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.454029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.454149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.454270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.454390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.454511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.454642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.454773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.454895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.455016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.455147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.455268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.455388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.455512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.455640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.455771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.455897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.456023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.456146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.456270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.456393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.456517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.456644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.456777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.456913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.457040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.457170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.457314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.457454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.457593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.457727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.457856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.457982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.458108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.458231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.458359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.458485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.458611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.458745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.458876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.459001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.459126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.459250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.459376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.459500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.459623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.459767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.459864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.459952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.460039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.460124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.460204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.460283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.460365] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.461756] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.461762] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19892, lrc_seqno=19892, guc_id=0, flags=0x73 in no process [-1] <7> [280.461765] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.461826] ------------[ cut here ]------------ <4> [280.461827] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.461828] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3449 <4> [280.461902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.461971] autofs4 [last unloaded: snd_hda_intel] <4> [280.461976] CPU: 2 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.461979] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.461980] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.461982] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.461987] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.462058] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.462059] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.462062] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.462063] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.462064] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.462066] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.462067] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.462068] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.462070] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.462071] CR2: 00005adf763539e0 CR3: 00000001240fe005 CR4: 0000000000f72ef0 <4> [280.462073] PKRU: 55555554 <4> [280.462074] Call Trace: <4> [280.462075] <TASK> <4> [280.462079] ? lock_sync+0x100/0x100 <4> [280.462084] ? lock_release+0xd0/0x2b0 <4> [280.462090] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.462095] process_one_work+0x239/0x760 <4> [280.462102] worker_thread+0x200/0x3f0 <4> [280.462105] ? __pfx_worker_thread+0x10/0x10 <4> [280.462107] kthread+0x10d/0x150 <4> [280.462110] ? __pfx_kthread+0x10/0x10 <4> [280.462114] ret_from_fork+0x3d4/0x480 <4> [280.462117] ? __pfx_kthread+0x10/0x10 <4> [280.462120] ret_from_fork_asm+0x1a/0x30 <4> [280.462128] </TASK> <4> [280.462129] irq event stamp: 514177 <4> [280.462130] hardirqs last enabled at (514183): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.462134] hardirqs last disabled at (514188): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.462136] softirqs last enabled at (510896): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.462139] softirqs last disabled at (510891): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.462141] ---[ end trace 0000000000000000 ]--- <6> [280.462143] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.462214] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.462220] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.462271] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.462877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.462972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.463068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.463156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.463242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.463328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.463415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.463504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.463587] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.463684] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.463835] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.464916] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.474696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.474947] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.476268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.476347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.476425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.476505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.476585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.476662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.476763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.476839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.476915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.476991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.477066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.477141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.477216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.477290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.477365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.477440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.477514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.477589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.477663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.477754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.477838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.477920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.478005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.478087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.478165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.478242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.478320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.478399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.478480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.478558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.478638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.478722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.478808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.478897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.478984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.479067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.479147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.479225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.479304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.479380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.479460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.479538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.479616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.479696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.479776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.479857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.479937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.480017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.480098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.480175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.480253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.480331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.480409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.480489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.480571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.480654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.480745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.480826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.480908] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.482090] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.482094] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19892, lrc_seqno=19892, guc_id=0, flags=0x73 in no process [-1] <7> [280.482097] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.482156] ------------[ cut here ]------------ <4> [280.482158] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.482159] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3449 <4> [280.482232] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.482299] autofs4 [last unloaded: snd_hda_intel] <4> [280.482303] CPU: 2 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.482306] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.482308] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.482309] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.482314] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.482384] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.482386] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.482388] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.482390] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.482391] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.482392] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.482393] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.482395] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.482396] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.482398] CR2: 00005adf763539e0 CR3: 00000001240fe005 CR4: 0000000000f72ef0 <4> [280.482399] PKRU: 55555554 <4> [280.482400] Call Trace: <4> [280.482401] <TASK> <4> [280.482405] ? lock_sync+0x100/0x100 <4> [280.482410] ? lock_release+0xd0/0x2b0 <4> [280.482416] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.482421] process_one_work+0x239/0x760 <4> [280.482428] worker_thread+0x200/0x3f0 <4> [280.482431] ? __pfx_worker_thread+0x10/0x10 <4> [280.482433] kthread+0x10d/0x150 <4> [280.482436] ? __pfx_kthread+0x10/0x10 <4> [280.482440] ret_from_fork+0x3d4/0x480 <4> [280.482442] ? __pfx_kthread+0x10/0x10 <4> [280.482445] ret_from_fork_asm+0x1a/0x30 <4> [280.482453] </TASK> <4> [280.482454] irq event stamp: 524999 <4> [280.482455] hardirqs last enabled at (525005): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.482458] hardirqs last disabled at (525010): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.482460] softirqs last enabled at (523406): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.482463] softirqs last disabled at (523399): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.482465] ---[ end trace 0000000000000000 ]--- <7> [280.485935] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.486136] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.490513] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19947, lrc_seqno=19947, guc_id=0, flags=0x73 in no process [-1] <7> [280.490521] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.490616] ------------[ cut here ]------------ <4> [280.490618] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.490621] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:27/5331 <4> [280.490746] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.490861] autofs4 [last unloaded: snd_hda_intel] <4> [280.490868] CPU: 0 UID: 0 PID: 5331 Comm: kworker/u64:27 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.490873] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.490876] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.490879] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.490887] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.490986] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.490989] RSP: 0018:ffffc90003987ca0 EFLAGS: 00010246 <4> [280.490993] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.490995] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.490997] RBP: ffffc90003987db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.490999] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.491001] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.491004] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [280.491007] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.491010] CR2: 00005adf763539e0 CR3: 00000003a3a4e004 CR4: 0000000000f72ef0 <4> [280.491013] PKRU: 55555554 <4> [280.491015] Call Trace: <4> [280.491017] <TASK> <4> [280.491024] ? lock_sync+0x100/0x100 <4> [280.491034] ? lock_release+0xd0/0x2b0 <4> [280.491044] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.491052] process_one_work+0x239/0x760 <4> [280.491065] worker_thread+0x200/0x3f0 <4> [280.491070] ? __pfx_worker_thread+0x10/0x10 <4> [280.491074] kthread+0x10d/0x150 <4> [280.491078] ? __pfx_kthread+0x10/0x10 <4> [280.491084] ret_from_fork+0x3d4/0x480 <4> [280.491088] ? __pfx_kthread+0x10/0x10 <4> [280.491093] ret_from_fork_asm+0x1a/0x30 <4> [280.491106] </TASK> <4> [280.491108] irq event stamp: 520345 <4> [280.491110] hardirqs last enabled at (520351): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.491114] hardirqs last disabled at (520356): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.491118] softirqs last enabled at (519602): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.491122] softirqs last disabled at (519571): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.491126] ---[ end trace 0000000000000000 ]--- <6> [280.491365] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.491447] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.491455] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.491528] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.492671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.492792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.492890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.492980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.493068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.493154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.493243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.493330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.493414] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.493510] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.493639] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.494736] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.504700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.504957] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.506029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.506123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.506200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.506279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.506355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.506433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.506512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.506591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.506670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.506758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.506848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.506927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.507006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.507085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.507164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.507246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.507326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.507405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.507479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.507561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.507644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.507741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.507827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.507906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.507984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.508060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.508137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.508217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.508307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.508385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.508464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.508547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.508644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.508753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.508842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.508925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.509009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.509090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.509170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.509246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.509326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.509405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.509481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.509558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.509639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.509740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.509819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.509899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.509982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.510061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.510139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.510222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.510303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.510382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.510460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.510538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.510614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.510697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.510776] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.512101] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.512106] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19947, lrc_seqno=19947, guc_id=0, flags=0x73 in no process [-1] <7> [280.512109] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.512173] ------------[ cut here ]------------ <4> [280.512174] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.512175] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:16/3449 <4> [280.512249] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.512320] autofs4 [last unloaded: snd_hda_intel] <4> [280.512325] CPU: 11 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.512328] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.512329] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.512330] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.512336] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.512406] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.512408] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.512410] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.512412] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.512413] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.512414] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.512416] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.512417] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [280.512419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.512420] CR2: 00005adf763421c8 CR3: 000000033b287005 CR4: 0000000000f72ef0 <4> [280.512421] PKRU: 55555554 <4> [280.512423] Call Trace: <4> [280.512424] <TASK> <4> [280.512428] ? lock_sync+0x100/0x100 <4> [280.512433] ? lock_release+0xd0/0x2b0 <4> [280.512439] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.512444] process_one_work+0x239/0x760 <4> [280.512452] worker_thread+0x200/0x3f0 <4> [280.512454] ? __pfx_worker_thread+0x10/0x10 <4> [280.512457] kthread+0x10d/0x150 <4> [280.512460] ? __pfx_kthread+0x10/0x10 <4> [280.512464] ret_from_fork+0x3d4/0x480 <4> [280.512466] ? __pfx_kthread+0x10/0x10 <4> [280.512470] ret_from_fork_asm+0x1a/0x30 <4> [280.512477] </TASK> <4> [280.512479] irq event stamp: 537881 <4> [280.512480] hardirqs last enabled at (537887): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.512483] hardirqs last disabled at (537892): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.512485] softirqs last enabled at (534702): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.512488] softirqs last disabled at (534695): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.512490] ---[ end trace 0000000000000000 ]--- <6> [280.512492] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.512562] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.512570] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.513548] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.513664] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.513786] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.514605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.514753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.514896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.515032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.515167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.515302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.515436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.515573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.515710] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.515854] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.516026] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.517731] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.528513] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.528832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.529980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.530102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.530221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.530343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.530463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.530584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.530711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.530832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.530953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.531074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.531195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.531316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.531436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.531557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.531678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.531812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.531901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.531983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.532061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.532145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.532229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.532310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.532390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.532469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.532548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.532626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.532708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.532790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.532875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.532957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.533039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.533122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.533210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.533296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.533381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.533462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.533547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.533630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.533715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.533795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.533876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.533955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.534034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.534110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.534191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.534269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.534346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.534427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.534510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.534591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.534668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.534804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.534884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.534962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.535041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.535124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.535205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.535282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.535362] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.536708] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.536713] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=19947, lrc_seqno=19947, guc_id=0, flags=0x73 in no process [-1] <7> [280.536716] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.536775] ------------[ cut here ]------------ <4> [280.536777] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.536778] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:23/3456 <4> [280.536850] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.536916] autofs4 [last unloaded: snd_hda_intel] <4> [280.536920] CPU: 8 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.536923] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.536924] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.536926] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.536931] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.537001] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.537003] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [280.537005] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.537007] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.537008] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.537009] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.537010] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.537012] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.537013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.537015] CR2: 00005adf7634d890 CR3: 00000001240fe003 CR4: 0000000000f72ef0 <4> [280.537016] PKRU: 55555554 <4> [280.537018] Call Trace: <4> [280.537019] <TASK> <4> [280.537023] ? lock_sync+0x100/0x100 <4> [280.537028] ? lock_release+0xd0/0x2b0 <4> [280.537033] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.537039] process_one_work+0x239/0x760 <4> [280.537045] worker_thread+0x200/0x3f0 <4> [280.537048] ? __pfx_worker_thread+0x10/0x10 <4> [280.537051] kthread+0x10d/0x150 <4> [280.537054] ? __pfx_kthread+0x10/0x10 <4> [280.537057] ret_from_fork+0x3d4/0x480 <4> [280.537059] ? __pfx_kthread+0x10/0x10 <4> [280.537063] ret_from_fork_asm+0x1a/0x30 <4> [280.537070] </TASK> <4> [280.537071] irq event stamp: 1034755 <4> [280.537073] hardirqs last enabled at (1034761): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.537076] hardirqs last disabled at (1034766): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.537078] softirqs last enabled at (1032140): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.537081] softirqs last disabled at (1032107): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.537083] ---[ end trace 0000000000000000 ]--- <7> [280.539913] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.540140] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.540937] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20002, lrc_seqno=20002, guc_id=0, flags=0x73 in no process [-1] <7> [280.540948] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.541125] ------------[ cut here ]------------ <4> [280.541127] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.541131] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#15: kworker/u64:23/3456 <4> [280.541323] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.541472] autofs4 [last unloaded: snd_hda_intel] <4> [280.541481] CPU: 15 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.541488] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.541491] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.541494] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.541507] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.541704] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.541709] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [280.541714] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.541718] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.541721] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.541724] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.541727] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.541730] FS: 0000000000000000(0000) GS:ffff8888db417000(0000) knlGS:0000000000000000 <4> [280.541734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.541737] CR2: 00005adf76351cd8 CR3: 0000000126cf8004 CR4: 0000000000f72ef0 <4> [280.541741] PKRU: 55555554 <4> [280.541743] Call Trace: <4> [280.541746] <TASK> <4> [280.541756] ? lock_sync+0x100/0x100 <4> [280.541768] ? lock_release+0xd0/0x2b0 <4> [280.541782] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.541797] process_one_work+0x239/0x760 <4> [280.541813] worker_thread+0x200/0x3f0 <4> [280.541820] ? __pfx_worker_thread+0x10/0x10 <4> [280.541826] kthread+0x10d/0x150 <4> [280.541832] ? __pfx_kthread+0x10/0x10 <4> [280.541841] ret_from_fork+0x3d4/0x480 <4> [280.541845] ? __pfx_kthread+0x10/0x10 <4> [280.541853] ret_from_fork_asm+0x1a/0x30 <4> [280.541872] </TASK> <4> [280.541875] irq event stamp: 1037477 <4> [280.541878] hardirqs last enabled at (1037483): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.541884] hardirqs last disabled at (1037488): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.541889] softirqs last enabled at (1037316): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.541895] softirqs last disabled at (1037311): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.541900] ---[ end trace 0000000000000000 ]--- <6> [280.541904] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.542088] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.542103] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.542160] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.543361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.543569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.543788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.543990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.544192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.544385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.544576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.544790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.544920] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.545027] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.545146] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.546161] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.556720] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.556973] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.557998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.558077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.558155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.558233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.558314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.558393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.558471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.558547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.558623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.558703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.558778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.558852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.558926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.559000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.559074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.559148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.559223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.559297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.559374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.559460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.559542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.559623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.559707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.559786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.559864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.559941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.560019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.560100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.560180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.560259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.560338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.560418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.560504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.560589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.560674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.560769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.560850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.560931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.561012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.561092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.561178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.561261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.561341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.561420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.561502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.561580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.561659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.561745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.561824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.561900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.561976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.562055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.562136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.562217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.562296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.562376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.562453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.562530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.562609] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.563899] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.563905] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20002, lrc_seqno=20002, guc_id=0, flags=0x73 in no process [-1] <7> [280.563907] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.563967] ------------[ cut here ]------------ <4> [280.563968] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.563970] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:23/3456 <4> [280.564042] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.564110] autofs4 [last unloaded: snd_hda_intel] <4> [280.564114] CPU: 8 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.564117] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.564119] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.564120] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.564125] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.564196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.564198] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [280.564200] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.564202] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.564203] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.564204] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.564206] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.564207] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.564209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.564210] CR2: 00007b83c2308000 CR3: 0000000123a00002 CR4: 0000000000f72ef0 <4> [280.564211] PKRU: 55555554 <4> [280.564213] Call Trace: <4> [280.564214] <TASK> <4> [280.564218] ? lock_sync+0x100/0x100 <4> [280.564223] ? lock_release+0xd0/0x2b0 <4> [280.564228] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.564234] process_one_work+0x239/0x760 <4> [280.564241] worker_thread+0x200/0x3f0 <4> [280.564243] ? __pfx_worker_thread+0x10/0x10 <4> [280.564246] kthread+0x10d/0x150 <4> [280.564249] ? __pfx_kthread+0x10/0x10 <4> [280.564253] ret_from_fork+0x3d4/0x480 <4> [280.564255] ? __pfx_kthread+0x10/0x10 <4> [280.564258] ret_from_fork_asm+0x1a/0x30 <4> [280.564266] </TASK> <4> [280.564267] irq event stamp: 1048145 <4> [280.564268] hardirqs last enabled at (1048151): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.564271] hardirqs last disabled at (1048156): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.564273] softirqs last enabled at (1044900): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.564276] softirqs last disabled at (1044893): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.564278] ---[ end trace 0000000000000000 ]--- <6> [280.564281] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.564351] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.564357] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.565659] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.565774] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.565881] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.566450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.566540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.566633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.566732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.566823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.566911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.566999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.567087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.567171] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.567268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.567385] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.568394] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.578696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.578949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.579968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.580048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.580126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.580204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.580281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.580356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.580432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.580508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.580585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.580663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.580751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.580827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.580902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.580977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.581051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.581126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.581199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.581273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.581347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.581428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.581511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.581591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.581673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.581768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.581848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.581926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.582003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.582084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.582164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.582243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.582323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.582403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.582489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.582573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.582658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.582748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.582831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.582908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.582986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.583063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.583143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.583226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.583308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.583386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.583468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.583546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.583624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.583705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.583784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.583865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.583946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.584028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.584108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.584186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.584263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.584341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.584415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.584492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.584573] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.585813] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.585818] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20002, lrc_seqno=20002, guc_id=0, flags=0x73 in no process [-1] <7> [280.585820] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.585880] ------------[ cut here ]------------ <4> [280.585882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.585883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:23/3456 <4> [280.585956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.586023] autofs4 [last unloaded: snd_hda_intel] <4> [280.586027] CPU: 8 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.586030] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.586031] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.586032] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.586038] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.586108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.586110] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [280.586112] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.586113] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.586115] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.586116] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.586117] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.586118] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.586120] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.586121] CR2: 00007b83c2308000 CR3: 0000000123a00002 CR4: 0000000000f72ef0 <4> [280.586123] PKRU: 55555554 <4> [280.586124] Call Trace: <4> [280.586125] <TASK> <4> [280.586129] ? lock_sync+0x100/0x100 <4> [280.586134] ? lock_release+0xd0/0x2b0 <4> [280.586139] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.586144] process_one_work+0x239/0x760 <4> [280.586151] worker_thread+0x200/0x3f0 <4> [280.586154] ? __pfx_worker_thread+0x10/0x10 <4> [280.586156] kthread+0x10d/0x150 <4> [280.586159] ? __pfx_kthread+0x10/0x10 <4> [280.586163] ret_from_fork+0x3d4/0x480 <4> [280.586165] ? __pfx_kthread+0x10/0x10 <4> [280.586168] ret_from_fork_asm+0x1a/0x30 <4> [280.586176] </TASK> <4> [280.586177] irq event stamp: 1058811 <4> [280.586178] hardirqs last enabled at (1058817): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.586181] hardirqs last disabled at (1058822): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.586183] softirqs last enabled at (1055384): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.586186] softirqs last disabled at (1055375): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.586188] ---[ end trace 0000000000000000 ]--- <5> [280.589881] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20057, lrc_seqno=20057, guc_id=0, flags=0x73 in no process [-1] <7> [280.589889] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [280.589893] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [280.590015] ------------[ cut here ]------------ <4> [280.590017] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.590019] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#15: kworker/u64:16/3449 <7> [280.590040] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [280.590143] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.590246] autofs4 [last unloaded: snd_hda_intel] <4> [280.590253] CPU: 15 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.590257] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.590259] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.590262] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.590271] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.590393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.590396] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.590399] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.590402] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.590404] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.590407] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.590409] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.590412] FS: 0000000000000000(0000) GS:ffff8888db417000(0000) knlGS:0000000000000000 <4> [280.590414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.590417] CR2: 00005adf763539e0 CR3: 000000011bc46004 CR4: 0000000000f72ef0 <4> [280.590419] PKRU: 55555554 <4> [280.590421] Call Trace: <4> [280.590424] <TASK> <4> [280.590431] ? lock_sync+0x100/0x100 <4> [280.590439] ? lock_release+0xd0/0x2b0 <4> [280.590449] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.590459] process_one_work+0x239/0x760 <4> [280.590471] worker_thread+0x200/0x3f0 <4> [280.590475] ? __pfx_worker_thread+0x10/0x10 <4> [280.590479] kthread+0x10d/0x150 <4> [280.590484] ? __pfx_kthread+0x10/0x10 <4> [280.590490] ret_from_fork+0x3d4/0x480 <4> [280.590494] ? __pfx_kthread+0x10/0x10 <4> [280.590499] ret_from_fork_asm+0x1a/0x30 <4> [280.590513] </TASK> <4> [280.590515] irq event stamp: 543645 <4> [280.590517] hardirqs last enabled at (543651): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.590522] hardirqs last disabled at (543656): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.590525] softirqs last enabled at (542534): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [280.590529] softirqs last disabled at (542532): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [280.590533] ---[ end trace 0000000000000000 ]--- <6> [280.590537] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.590659] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.590669] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.590729] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.591569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.591717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.591860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.591995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.592129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.592261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.592395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.592529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.592660] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.592820] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.592950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.593967] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.603697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.603952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.604966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.605048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.605126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.605204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.605281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.605357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.605433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.605508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.605584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.605658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.605748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.605856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.605945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.606028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.606108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.606187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.606266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.606344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.606422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.606505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.606588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.606667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.606835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.606950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.607064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.607176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.607287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.607402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.607518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.607631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.607816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.607932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.608053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.608166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.608256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.608341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.608423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.608503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.608583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.608661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.608755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.608836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.608919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.609025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.609126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.609209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.609287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.609366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.609449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.609528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.609605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.609684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.609777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.609855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.609934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.610016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.610094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.610171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.610251] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.611597] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.611602] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20057, lrc_seqno=20057, guc_id=0, flags=0x73 in no process [-1] <7> [280.611605] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.611665] ------------[ cut here ]------------ <4> [280.611666] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.611667] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3449 <4> [280.611753] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.611831] autofs4 [last unloaded: snd_hda_intel] <4> [280.611836] CPU: 8 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.611840] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.611841] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.611843] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.611849] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.611919] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.611921] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.611924] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.611925] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.611927] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.611928] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.611930] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.611931] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.611933] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.611935] CR2: 00007b83c8970000 CR3: 00000001240fe004 CR4: 0000000000f72ef0 <4> [280.611937] PKRU: 55555554 <4> [280.611938] Call Trace: <4> [280.611939] <TASK> <4> [280.611944] ? lock_sync+0x100/0x100 <4> [280.611949] ? lock_release+0xd0/0x2b0 <4> [280.611955] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.611960] process_one_work+0x239/0x760 <4> [280.611967] worker_thread+0x200/0x3f0 <4> [280.611970] ? __pfx_worker_thread+0x10/0x10 <4> [280.611973] kthread+0x10d/0x150 <4> [280.611976] ? __pfx_kthread+0x10/0x10 <4> [280.611980] ret_from_fork+0x3d4/0x480 <4> [280.611983] ? __pfx_kthread+0x10/0x10 <4> [280.611986] ret_from_fork_asm+0x1a/0x30 <4> [280.611994] </TASK> <4> [280.611995] irq event stamp: 554639 <4> [280.611996] hardirqs last enabled at (554645): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.611999] hardirqs last disabled at (554650): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.612002] softirqs last enabled at (551254): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.612004] softirqs last disabled at (551219): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.612007] ---[ end trace 0000000000000000 ]--- <6> [280.612701] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.612818] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.612832] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.613283] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.613390] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.613509] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.614093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.614185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.614281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.614372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.614461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.614550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.614640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.614742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.614827] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.614924] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.615042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.616067] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.626696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.626949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.627984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.628064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.628141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.628219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.628297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.628377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.628455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.628531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.628608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.628683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.628773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.628848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.628923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.628997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.629071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.629145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.629219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.629294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.629368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.629448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.629531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.629613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.629699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.629778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.629856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.629934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.630010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.630091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.630172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.630252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.630330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.630409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.630494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.630578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.630665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.630758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.630841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.630921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.631000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.631077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.631157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.631236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.631313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.631389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.631470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.631547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.631624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.631702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.631780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.631855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.631932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.632012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.632094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.632174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.632252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.632331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.632408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.632485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.632566] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.633813] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.633818] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20057, lrc_seqno=20057, guc_id=0, flags=0x73 in no process [-1] <7> [280.633820] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.633880] ------------[ cut here ]------------ <4> [280.633881] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.633882] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3449 <4> [280.633954] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.634023] autofs4 [last unloaded: snd_hda_intel] <4> [280.634027] CPU: 6 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.634030] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.634031] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.634033] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.634038] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.634107] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.634108] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.634111] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.634112] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.634113] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.634115] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.634116] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.634117] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [280.634119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.634120] CR2: 00007b83c21f8000 CR3: 000000012943d001 CR4: 0000000000f72ef0 <4> [280.634122] PKRU: 55555554 <4> [280.634123] Call Trace: <4> [280.634124] <TASK> <4> [280.634128] ? lock_sync+0x100/0x100 <4> [280.634133] ? lock_release+0xd0/0x2b0 <4> [280.634138] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.634144] process_one_work+0x239/0x760 <4> [280.634151] worker_thread+0x200/0x3f0 <4> [280.634153] ? __pfx_worker_thread+0x10/0x10 <4> [280.634156] kthread+0x10d/0x150 <4> [280.634159] ? __pfx_kthread+0x10/0x10 <4> [280.634163] ret_from_fork+0x3d4/0x480 <4> [280.634165] ? __pfx_kthread+0x10/0x10 <4> [280.634168] ret_from_fork_asm+0x1a/0x30 <4> [280.634176] </TASK> <4> [280.634177] irq event stamp: 565291 <4> [280.634178] hardirqs last enabled at (565297): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.634181] hardirqs last disabled at (565302): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.634183] softirqs last enabled at (561764): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.634186] softirqs last disabled at (561759): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.634189] ---[ end trace 0000000000000000 ]--- <5> [280.636684] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20112, lrc_seqno=20112, guc_id=0, flags=0x73 in no process [-1] <7> [280.636700] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.636802] ------------[ cut here ]------------ <4> [280.636803] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.636805] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [280.636884] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.637010] autofs4 [last unloaded: snd_hda_intel] <4> [280.637017] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.637022] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.637024] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.637027] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.637036] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.637145] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.637148] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.637152] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.637154] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.637156] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.637157] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.637158] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.637160] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [280.637161] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.637163] CR2: 00007b83c8980000 CR3: 00000003405a8001 CR4: 0000000000f72ef0 <4> [280.637164] PKRU: 55555554 <4> [280.637165] Call Trace: <4> [280.637167] <TASK> <4> [280.637171] ? lock_sync+0x100/0x100 <4> [280.637176] ? lock_release+0xd0/0x2b0 <4> [280.637181] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.637188] process_one_work+0x239/0x760 <4> [280.637195] worker_thread+0x200/0x3f0 <4> [280.637198] ? __pfx_worker_thread+0x10/0x10 <4> [280.637200] kthread+0x10d/0x150 <4> [280.637203] ? __pfx_kthread+0x10/0x10 <4> [280.637207] ret_from_fork+0x3d4/0x480 <4> [280.637209] ? __pfx_kthread+0x10/0x10 <4> [280.637213] ret_from_fork_asm+0x1a/0x30 <4> [280.637220] </TASK> <4> [280.637222] irq event stamp: 444021 <4> [280.637223] hardirqs last enabled at (444027): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.637226] hardirqs last disabled at (444032): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.637228] softirqs last enabled at (443254): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.637231] softirqs last disabled at (443245): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.637234] ---[ end trace 0000000000000000 ]--- <6> [280.637236] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [280.637223] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [280.637309] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.637317] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.637377] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.637533] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.638427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.638565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.638713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.638873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.638973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.639064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.639153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.639243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.639327] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.639423] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.639540] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.640578] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.650783] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.651046] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.652202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.652310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.652390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.652470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.652548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.652624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.652717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.652792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.652872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.652947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.653024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.653102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.653180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.653256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.653331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.653407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.653482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.653556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.653630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.653721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.653803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.653886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.653970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.654050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.654129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.654207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.654285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.654370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.654453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.654534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.654615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.654700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.654785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.654869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.654954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.655036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.655116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.655194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.655273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.655349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.655429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.655508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.655587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.655663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.655773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.655852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.655935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.656015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.656095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.656173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.656250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.656331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.656410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.656487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.656564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.656644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.656737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.656817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.656900] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.658198] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.658203] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20112, lrc_seqno=20112, guc_id=0, flags=0x73 in no process [-1] <7> [280.658206] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.658265] ------------[ cut here ]------------ <4> [280.658267] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.658268] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:6/205 <4> [280.658341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.658411] autofs4 [last unloaded: snd_hda_intel] <4> [280.658416] CPU: 8 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.658419] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.658420] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.658421] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.658427] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.658496] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.658498] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.658500] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.658502] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.658503] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.658505] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.658506] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.658507] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.658509] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.658510] CR2: 00007b83c22f8000 CR3: 00000001240fe006 CR4: 0000000000f72ef0 <4> [280.658512] PKRU: 55555554 <4> [280.658513] Call Trace: <4> [280.658514] <TASK> <4> [280.658518] ? lock_sync+0x100/0x100 <4> [280.658523] ? lock_release+0xd0/0x2b0 <4> [280.658529] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.658534] process_one_work+0x239/0x760 <4> [280.658542] worker_thread+0x200/0x3f0 <4> [280.658544] ? __pfx_worker_thread+0x10/0x10 <4> [280.658547] kthread+0x10d/0x150 <4> [280.658550] ? __pfx_kthread+0x10/0x10 <4> [280.658554] ret_from_fork+0x3d4/0x480 <4> [280.658556] ? __pfx_kthread+0x10/0x10 <4> [280.658559] ret_from_fork_asm+0x1a/0x30 <4> [280.658567] </TASK> <4> [280.658568] irq event stamp: 864537 <4> [280.658570] hardirqs last enabled at (864543): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.658573] hardirqs last disabled at (864548): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.658575] softirqs last enabled at (861166): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.658578] softirqs last disabled at (861161): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.658580] ---[ end trace 0000000000000000 ]--- <6> [280.658582] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.658652] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.658658] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.659073] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.659638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.659741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.659832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.659923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.660012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.660100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.660187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.660274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.660356] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.660452] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.660568] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.661580] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.671704] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.671957] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.672984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.673077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.673154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.673231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.673307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.673383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.673458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.673533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.673607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.673681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.673780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.673858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.673935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.674011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.674087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.674162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.674236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.674313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.674386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.674467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.674549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.674630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.674723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.674804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.674883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.674962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.675039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.675122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.675205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.675286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.675366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.675447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.675536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.675624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.675715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.675797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.675878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.675956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.676034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.676110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.676190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.676268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.676345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.676422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.676502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.676578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.676657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.676746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.676828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.676909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.676988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.677070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.677148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.677227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.677303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.677380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.677456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.677532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.677611] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.678852] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.678856] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20112, lrc_seqno=20112, guc_id=0, flags=0x73 in no process [-1] <7> [280.678859] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.678919] ------------[ cut here ]------------ <4> [280.678920] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.678921] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:6/205 <4> [280.678993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.679060] autofs4 [last unloaded: snd_hda_intel] <4> [280.679064] CPU: 8 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.679068] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.679069] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.679070] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.679076] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.679146] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.679148] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.679150] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.679152] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.679154] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.679155] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.679156] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.679158] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.679160] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.679162] CR2: 00007b83c22f8000 CR3: 000000012943d001 CR4: 0000000000f72ef0 <4> [280.679163] PKRU: 55555554 <4> [280.679165] Call Trace: <4> [280.679166] <TASK> <4> [280.679170] ? lock_sync+0x100/0x100 <4> [280.679175] ? lock_release+0xd0/0x2b0 <4> [280.679181] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.679187] process_one_work+0x239/0x760 <4> [280.679194] worker_thread+0x200/0x3f0 <4> [280.679197] ? __pfx_worker_thread+0x10/0x10 <4> [280.679200] kthread+0x10d/0x150 <4> [280.679203] ? __pfx_kthread+0x10/0x10 <4> [280.679207] ret_from_fork+0x3d4/0x480 <4> [280.679210] ? __pfx_kthread+0x10/0x10 <4> [280.679213] ret_from_fork_asm+0x1a/0x30 <4> [280.679221] </TASK> <4> [280.679222] irq event stamp: 875265 <4> [280.679224] hardirqs last enabled at (875271): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.679227] hardirqs last disabled at (875276): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.679230] softirqs last enabled at (872020): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.679232] softirqs last disabled at (872009): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.679235] ---[ end trace 0000000000000000 ]--- <7> [280.681525] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.681657] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.681893] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20167, lrc_seqno=20167, guc_id=0, flags=0x73 in no process [-1] <7> [280.681898] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.681967] ------------[ cut here ]------------ <4> [280.681968] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.681970] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [280.682045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.682115] autofs4 [last unloaded: snd_hda_intel] <4> [280.682119] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.682123] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.682124] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.682126] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.682132] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.682212] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.682214] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.682217] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.682219] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.682220] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.682222] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.682223] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.682225] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [280.682226] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.682228] CR2: 00007b83c8970000 CR3: 000000036fe31005 CR4: 0000000000f72ef0 <4> [280.682230] PKRU: 55555554 <4> [280.682231] Call Trace: <4> [280.682233] <TASK> <4> [280.682237] ? lock_sync+0x100/0x100 <4> [280.682242] ? lock_release+0xd0/0x2b0 <4> [280.682248] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.682253] process_one_work+0x239/0x760 <4> [280.682260] worker_thread+0x200/0x3f0 <4> [280.682263] ? __pfx_worker_thread+0x10/0x10 <4> [280.682266] kthread+0x10d/0x150 <4> [280.682269] ? __pfx_kthread+0x10/0x10 <4> [280.682273] ret_from_fork+0x3d4/0x480 <4> [280.682275] ? __pfx_kthread+0x10/0x10 <4> [280.682279] ret_from_fork_asm+0x1a/0x30 <4> [280.682287] </TASK> <4> [280.682288] irq event stamp: 878289 <4> [280.682289] hardirqs last enabled at (878295): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.682293] hardirqs last disabled at (878300): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.682295] softirqs last enabled at (876900): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.682298] softirqs last disabled at (876893): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.682301] ---[ end trace 0000000000000000 ]--- <6> [280.682303] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.682376] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.682384] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.682437] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.683518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.683675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.683851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.683977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.684082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.684183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.684284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.684385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.684484] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.684581] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.684720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.685970] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.696717] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.697110] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.699003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.699091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.699175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.699264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.699353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.699443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.699529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.699603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.699683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.699797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.699887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.699974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.700065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.700154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.700251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.700338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.700451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.700695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.700791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.700877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.700959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.701040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.701123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.701204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.701284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.701363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.701443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.701527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.701696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.701803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.701891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.701979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.702105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.702325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.702435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.702523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.702607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.702695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.702776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.702854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.702935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.703013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.703090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.703166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.703247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.703323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.703399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.703476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.703553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.703628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.703711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.703790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.703871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.703954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.704033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.704114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.704192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.704270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.704349] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.705821] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.705827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20167, lrc_seqno=20167, guc_id=0, flags=0x73 in no process [-1] <7> [280.705829] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.705891] ------------[ cut here ]------------ <4> [280.705892] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.705893] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:23/3456 <4> [280.706010] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.706078] autofs4 [last unloaded: snd_hda_intel] <4> [280.706083] CPU: 8 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.706086] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.706087] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.706089] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.706095] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.706166] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.706168] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [280.706170] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.706171] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.706173] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.706174] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.706175] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.706177] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.706178] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.706180] CR2: 00007b83c8980000 CR3: 000000012943d001 CR4: 0000000000f72ef0 <4> [280.706181] PKRU: 55555554 <4> [280.706182] Call Trace: <4> [280.706183] <TASK> <4> [280.706187] ? lock_sync+0x100/0x100 <4> [280.706192] ? lock_release+0xd0/0x2b0 <4> [280.706198] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.706203] process_one_work+0x239/0x760 <4> [280.706211] worker_thread+0x200/0x3f0 <4> [280.706213] ? __pfx_worker_thread+0x10/0x10 <4> [280.706216] kthread+0x10d/0x150 <4> [280.706219] ? __pfx_kthread+0x10/0x10 <4> [280.706222] ret_from_fork+0x3d4/0x480 <4> [280.706225] ? __pfx_kthread+0x10/0x10 <4> [280.706228] ret_from_fork_asm+0x1a/0x30 <4> [280.706235] </TASK> <4> [280.706236] irq event stamp: 1079933 <4> [280.706238] hardirqs last enabled at (1079939): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.706241] hardirqs last disabled at (1079944): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.706243] softirqs last enabled at (1079018): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.706246] softirqs last disabled at (1079011): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.706248] ---[ end trace 0000000000000000 ]--- <6> [280.706250] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.706322] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.706330] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.707519] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.707628] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.707749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.708676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.708831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.708939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.709031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.709129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.709223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.709309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.709397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.709481] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.709589] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.709738] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.710974] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.721702] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.721988] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.723412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.723492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.723568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.723645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.723765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.723849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.723938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.724023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.724115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.724206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.724287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.724373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.724465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.724554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.724638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.724730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.724814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.724901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.724989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.725071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.725152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.725233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.725318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.725397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.725476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.725553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.725629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.725713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.725825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.725911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.726193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.726281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.726373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.726464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.726626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.726752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.726835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.726916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.726995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.727072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.727152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.727234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.727315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.727395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.727477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.727556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.727636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.727720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.727799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.727875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.727951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.728023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.728096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.728171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.728243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.728316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.728386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.728456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.728530] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.729732] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.729738] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20167, lrc_seqno=20167, guc_id=0, flags=0x73 in no process [-1] <7> [280.729741] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.729802] ------------[ cut here ]------------ <4> [280.729803] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.729804] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:27/5331 <4> [280.729869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.729930] autofs4 [last unloaded: snd_hda_intel] <4> [280.729934] CPU: 8 UID: 0 PID: 5331 Comm: kworker/u64:27 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.729937] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.729938] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.729939] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.729944] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.730007] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.730008] RSP: 0018:ffffc90003987ca0 EFLAGS: 00010246 <4> [280.730010] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.730012] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.730013] RBP: ffffc90003987db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.730014] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.730015] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.730017] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.730018] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.730020] CR2: 00007b83c8980000 CR3: 000000012943d001 CR4: 0000000000f72ef0 <4> [280.730021] PKRU: 55555554 <4> [280.730022] Call Trace: <4> [280.730023] <TASK> <4> [280.730027] ? lock_sync+0x100/0x100 <4> [280.730031] ? lock_release+0xd0/0x2b0 <4> [280.730036] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.730041] process_one_work+0x239/0x760 <4> [280.730047] worker_thread+0x200/0x3f0 <4> [280.730050] ? __pfx_worker_thread+0x10/0x10 <4> [280.730052] kthread+0x10d/0x150 <4> [280.730055] ? __pfx_kthread+0x10/0x10 <4> [280.730058] ret_from_fork+0x3d4/0x480 <4> [280.730060] ? __pfx_kthread+0x10/0x10 <4> [280.730063] ret_from_fork_asm+0x1a/0x30 <4> [280.730070] </TASK> <4> [280.730071] irq event stamp: 537235 <4> [280.730072] hardirqs last enabled at (537241): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.730075] hardirqs last disabled at (537246): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.730077] softirqs last enabled at (536426): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.730079] softirqs last disabled at (536399): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.730081] ---[ end trace 0000000000000000 ]--- <5> [280.731802] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20222, lrc_seqno=20222, guc_id=0, flags=0x73 in no process [-1] <7> [280.731811] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.731945] ------------[ cut here ]------------ <4> [280.731947] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.731950] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [280.732038] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi <7> [280.732029] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [280.732100] acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [280.732112] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.732115] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.732116] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.732117] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.732123] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.732197] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.732198] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.732201] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.732203] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.732204] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.732205] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.732206] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.732208] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.732210] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.732211] CR2: 00007b83c8970000 CR3: 0000000341421002 CR4: 0000000000f72ef0 <4> [280.732213] PKRU: 55555554 <4> [280.732214] Call Trace: <4> [280.732215] <TASK> <4> [280.732219] ? lock_sync+0x100/0x100 <4> [280.732224] ? lock_release+0xd0/0x2b0 <4> [280.732229] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.732235] process_one_work+0x239/0x760 <7> [280.732176] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [280.732242] worker_thread+0x200/0x3f0 <4> [280.732245] ? __pfx_worker_thread+0x10/0x10 <4> [280.732247] kthread+0x10d/0x150 <4> [280.732250] ? __pfx_kthread+0x10/0x10 <4> [280.732253] ret_from_fork+0x3d4/0x480 <4> [280.732255] ? __pfx_kthread+0x10/0x10 <4> [280.732258] ret_from_fork_asm+0x1a/0x30 <4> [280.732265] </TASK> <4> [280.732266] irq event stamp: 882909 <4> [280.732267] hardirqs last enabled at (882915): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.732270] hardirqs last disabled at (882920): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.732272] softirqs last enabled at (879718): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.732274] softirqs last disabled at (879713): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.732276] ---[ end trace 0000000000000000 ]--- <6> [280.732279] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.732352] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.732360] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.732405] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.733094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.733188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.733282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.733378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.733470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.733559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.733649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.733764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.733849] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.733949] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.734090] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.735333] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.745700] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.745994] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.747137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.747221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.747299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.747378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.747469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.747563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.747640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.747729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.747814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.748204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.748303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.748388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.748471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.748600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.748693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.748781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.748870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.748953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.749040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.749122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.749204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.749286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.749370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.749449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.749527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.749604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.749693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.749778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.749879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.749978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.750088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.750177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.750294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.750381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.750470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.750556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.750637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.750743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.750822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.750899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.750979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.751057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.751138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.751219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.751303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.751381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.751460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.751537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.751616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.751702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.751782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.751866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.751947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.752026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.752103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.752183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.752259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.752337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.752417] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.753863] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.753868] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20222, lrc_seqno=20222, guc_id=0, flags=0x73 in no process [-1] <7> [280.753871] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.753933] ------------[ cut here ]------------ <4> [280.753934] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.753936] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [280.754007] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.754076] autofs4 [last unloaded: snd_hda_intel] <4> [280.754080] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.754083] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.754084] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.754086] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.754091] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.754162] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.754164] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [280.754166] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.754168] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.754169] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.754170] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.754171] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.754173] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.754174] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.754176] CR2: 00007b83c8970000 CR3: 0000000341421002 CR4: 0000000000f72ef0 <4> [280.754177] PKRU: 55555554 <4> [280.754179] Call Trace: <4> [280.754180] <TASK> <4> [280.754184] ? lock_sync+0x100/0x100 <4> [280.754189] ? lock_release+0xd0/0x2b0 <4> [280.754194] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.754200] process_one_work+0x239/0x760 <4> [280.754207] worker_thread+0x200/0x3f0 <4> [280.754210] ? __pfx_worker_thread+0x10/0x10 <4> [280.754212] kthread+0x10d/0x150 <4> [280.754215] ? __pfx_kthread+0x10/0x10 <4> [280.754219] ret_from_fork+0x3d4/0x480 <4> [280.754221] ? __pfx_kthread+0x10/0x10 <4> [280.754224] ret_from_fork_asm+0x1a/0x30 <4> [280.754232] </TASK> <4> [280.754233] irq event stamp: 894023 <4> [280.754234] hardirqs last enabled at (894029): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.754237] hardirqs last disabled at (894034): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.754240] softirqs last enabled at (890790): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.754242] softirqs last disabled at (890783): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.754245] ---[ end trace 0000000000000000 ]--- <6> [280.754247] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.754316] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.754324] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.755470] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.755581] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.755692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.756589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.756705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.756805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.756910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.757004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.757129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.757271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.757431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.757554] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.757714] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.757860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.759128] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.769697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.769974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.771433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.771517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.771619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.771805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.771975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.772114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.772307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.772432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.772590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.772755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.772843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.772926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.773016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.773104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.773193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.773318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.773401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.773492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.773573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.773654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.773757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.773840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.773922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.774002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.774080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.774157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.774234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.774313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.774393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.774484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.774572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.774657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.774791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.774876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.775026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.775123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.775203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.775280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.775357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.775435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.775514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.775592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.775671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.775766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.775851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.775930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.776008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.776085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.776163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.776240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.776317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.776397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.776474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.776552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.776628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.776714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.776790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.776864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.776945] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.778283] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.778287] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20222, lrc_seqno=20222, guc_id=0, flags=0x73 in no process [-1] <7> [280.778290] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.778346] ------------[ cut here ]------------ <4> [280.778347] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.778348] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:23/3456 <4> [280.778413] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.778475] autofs4 [last unloaded: snd_hda_intel] <4> [280.778479] CPU: 2 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.778481] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.778483] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.778484] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.778489] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.778553] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.778554] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [280.778557] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.778558] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.778559] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.778560] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.778561] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.778563] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [280.778564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.778565] CR2: 00007b83c8970000 CR3: 000000012943d005 CR4: 0000000000f72ef0 <4> [280.778567] PKRU: 55555554 <4> [280.778568] Call Trace: <4> [280.778569] <TASK> <4> [280.778572] ? lock_sync+0x100/0x100 <4> [280.778577] ? lock_release+0xd0/0x2b0 <4> [280.778582] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.778587] process_one_work+0x239/0x760 <4> [280.778593] worker_thread+0x200/0x3f0 <4> [280.778595] ? __pfx_worker_thread+0x10/0x10 <4> [280.778598] kthread+0x10d/0x150 <4> [280.778600] ? __pfx_kthread+0x10/0x10 <4> [280.778604] ret_from_fork+0x3d4/0x480 <4> [280.778606] ? __pfx_kthread+0x10/0x10 <4> [280.778609] ret_from_fork_asm+0x1a/0x30 <4> [280.778616] </TASK> <4> [280.778617] irq event stamp: 1093573 <4> [280.778618] hardirqs last enabled at (1093579): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.778620] hardirqs last disabled at (1093584): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.778623] softirqs last enabled at (1090210): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.778625] softirqs last disabled at (1090203): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.778627] ---[ end trace 0000000000000000 ]--- <5> [280.779766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20277, lrc_seqno=20277, guc_id=0, flags=0x73 in no process [-1] <7> [280.779780] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.780072] ------------[ cut here ]------------ <4> [280.780074] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.780076] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:15/3448 <4> [280.780180] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.780313] autofs4 [last unloaded: snd_hda_intel] <4> [280.780321] CPU: 3 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.780326] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.780328] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.780331] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [280.780310] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [280.780341] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.780463] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.780466] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.780469] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.780471] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.780475] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.780477] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.780479] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.780482] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [280.780485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.780487] CR2: 00005adf76340e50 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [280.780489] PKRU: 55555554 <4> [280.780491] Call Trace: <4> [280.780493] <TASK> <4> [280.780499] ? lock_sync+0x100/0x100 <4> [280.780506] ? lock_release+0xd0/0x2b0 <4> [280.780514] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.780524] process_one_work+0x239/0x760 <4> [280.780535] worker_thread+0x200/0x3f0 <4> [280.780540] ? __pfx_worker_thread+0x10/0x10 <4> [280.780544] kthread+0x10d/0x150 <7> [280.780477] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [280.780549] ? __pfx_kthread+0x10/0x10 <4> [280.780554] ret_from_fork+0x3d4/0x480 <4> [280.780557] ? __pfx_kthread+0x10/0x10 <4> [280.780561] ret_from_fork_asm+0x1a/0x30 <4> [280.780572] </TASK> <4> [280.780574] irq event stamp: 1402775 <4> [280.780575] hardirqs last enabled at (1402781): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.780579] hardirqs last disabled at (1402786): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.780581] softirqs last enabled at (1401906): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.780585] softirqs last disabled at (1401901): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.780588] ---[ end trace 0000000000000000 ]--- <6> [280.780591] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.781706] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.781719] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.781777] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.782711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.782832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.782959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.783079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.783195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.783317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.783434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.783562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.783681] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.783841] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.784011] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.785311] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.795703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.796040] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.797507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.797619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.797740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.797854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.797960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.798068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.798183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.798292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.798406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.798515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.798627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.798873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.799035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.799142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.799256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.799359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.799468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.799574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.799676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.799806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.799915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.800019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.800127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.800234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.800343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.800449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.800554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.800663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.800799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.800925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.801048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.801176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.801324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.801469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.801614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.801738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.801856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.801963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.802069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.802173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.802281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.802389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.802496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.802605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.802733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.802829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.802917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.803001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.803081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.803159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.803238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.803319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.803399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.803477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.803555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.803634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.803718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.803797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.803882] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.805456] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.805461] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20277, lrc_seqno=20277, guc_id=0, flags=0x73 in no process [-1] <7> [280.805464] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.805525] ------------[ cut here ]------------ <4> [280.805526] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.805528] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:15/3448 <4> [280.805600] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.805669] autofs4 [last unloaded: snd_hda_intel] <4> [280.805673] CPU: 10 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.805676] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.805678] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.805679] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.805685] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.805777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.805779] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.805781] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.805783] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.805784] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.805786] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.805787] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.805789] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [280.805791] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.805793] CR2: 00007b83c21e8000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [280.805795] PKRU: 55555554 <4> [280.805796] Call Trace: <4> [280.805797] <TASK> <4> [280.805802] ? lock_sync+0x100/0x100 <4> [280.805807] ? lock_release+0xd0/0x2b0 <4> [280.805812] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.805818] process_one_work+0x239/0x760 <4> [280.805825] worker_thread+0x200/0x3f0 <4> [280.805828] ? __pfx_worker_thread+0x10/0x10 <4> [280.805831] kthread+0x10d/0x150 <4> [280.805835] ? __pfx_kthread+0x10/0x10 <4> [280.805838] ret_from_fork+0x3d4/0x480 <4> [280.805841] ? __pfx_kthread+0x10/0x10 <4> [280.805844] ret_from_fork_asm+0x1a/0x30 <4> [280.805852] </TASK> <4> [280.805854] irq event stamp: 1413467 <4> [280.805855] hardirqs last enabled at (1413473): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.805859] hardirqs last disabled at (1413478): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.805861] softirqs last enabled at (1413306): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.805864] softirqs last disabled at (1413299): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.805866] ---[ end trace 0000000000000000 ]--- <6> [280.805869] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.805940] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.805947] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.806001] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.806660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.806766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.806860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.806958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.807057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.807149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.807245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.807336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.807423] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.807529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.807692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.808914] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.818698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.818988] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.820048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.820130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.820206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.820299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.820391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.820479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.820569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.820655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.820805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.820894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.820979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.821058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.821194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.821277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.821372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.821454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.821546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.821635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.821729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.821810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.821892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.821973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.822054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.822132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.822210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.822287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.822363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.822442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.822526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.822609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.822694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.822810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.823078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.823183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.823279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.823364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.823444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.823522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.823599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.823676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.823768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.823847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.823925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.824002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.824082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.824160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.824242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.824322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.824402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.824482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.824562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.824645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.824731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.824809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.824886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.824967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.825048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.825128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.825209] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.826592] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.826597] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20277, lrc_seqno=20277, guc_id=0, flags=0x73 in no process [-1] <7> [280.826599] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.826660] ------------[ cut here ]------------ <4> [280.826662] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.826663] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:15/3448 <4> [280.826787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.826860] autofs4 [last unloaded: snd_hda_intel] <4> [280.826865] CPU: 10 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.826868] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.826869] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.826871] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.826876] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.826947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.826949] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.826952] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.826954] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.826955] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.826957] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.826958] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.826960] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [280.826961] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.826963] CR2: 00007b83c21e8000 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [280.826965] PKRU: 55555554 <4> [280.826966] Call Trace: <4> [280.826967] <TASK> <4> [280.826971] ? lock_sync+0x100/0x100 <4> [280.826976] ? lock_release+0xd0/0x2b0 <4> [280.826982] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.826988] process_one_work+0x239/0x760 <4> [280.826994] worker_thread+0x200/0x3f0 <4> [280.826997] ? __pfx_worker_thread+0x10/0x10 <4> [280.827000] kthread+0x10d/0x150 <4> [280.827003] ? __pfx_kthread+0x10/0x10 <4> [280.827007] ret_from_fork+0x3d4/0x480 <4> [280.827009] ? __pfx_kthread+0x10/0x10 <4> [280.827012] ret_from_fork_asm+0x1a/0x30 <4> [280.827020] </TASK> <4> [280.827021] irq event stamp: 1424177 <4> [280.827023] hardirqs last enabled at (1424183): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.827025] hardirqs last disabled at (1424188): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.827028] softirqs last enabled at (1423434): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.827030] softirqs last disabled at (1423403): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.827032] ---[ end trace 0000000000000000 ]--- <7> [280.828796] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.828960] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.829836] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20332, lrc_seqno=20332, guc_id=0, flags=0x73 in no process [-1] <7> [280.829842] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.829965] ------------[ cut here ]------------ <4> [280.829967] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.829969] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:15/3448 <4> [280.830052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.830121] autofs4 [last unloaded: snd_hda_intel] <4> [280.830126] CPU: 8 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.830129] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.830130] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.830131] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.830137] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.830210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.830212] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.830215] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.830216] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.830218] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.830219] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.830221] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.830222] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.830224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.830225] CR2: 00005adf76351cd8 CR3: 000000039dcdf004 CR4: 0000000000f72ef0 <4> [280.830227] PKRU: 55555554 <4> [280.830228] Call Trace: <4> [280.830229] <TASK> <4> [280.830233] ? lock_sync+0x100/0x100 <4> [280.830238] ? lock_release+0xd0/0x2b0 <4> [280.830243] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.830249] process_one_work+0x239/0x760 <4> [280.830255] worker_thread+0x200/0x3f0 <4> [280.830258] ? __pfx_worker_thread+0x10/0x10 <4> [280.830261] kthread+0x10d/0x150 <4> [280.830263] ? __pfx_kthread+0x10/0x10 <4> [280.830267] ret_from_fork+0x3d4/0x480 <4> [280.830269] ? __pfx_kthread+0x10/0x10 <4> [280.830273] ret_from_fork_asm+0x1a/0x30 <4> [280.830280] </TASK> <4> [280.830281] irq event stamp: 1427893 <4> [280.830283] hardirqs last enabled at (1427899): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.830286] hardirqs last disabled at (1427904): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.830288] softirqs last enabled at (1426790): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.830291] softirqs last disabled at (1426785): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.830293] ---[ end trace 0000000000000000 ]--- <6> [280.830296] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.830368] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.830377] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.830453] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.831158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.831316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.831468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.831564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.831664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.831780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.831877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.831976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.832062] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.832158] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.832296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.833608] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.843695] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.843964] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.845765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.845844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.845914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.845998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.846091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.846199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.846279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.846365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.846443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.846529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.846610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.846750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.846828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.846908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.847024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.847106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.847190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.847277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.847362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.847446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.847528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.847608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.847702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.847781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.847859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.847938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.848017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.848099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.848413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.848502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.848695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.848795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.848905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.849229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.849439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.849524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.849608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.849692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.849773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.849851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.849931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.850009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.850086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.850164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.850251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.850333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.850413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.850491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.850571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.850648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.850733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.850813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.850891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.850972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.851051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.851131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.851209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.851286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.851367] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.852713] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.852718] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20332, lrc_seqno=20332, guc_id=0, flags=0x73 in no process [-1] <7> [280.852721] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.852783] ------------[ cut here ]------------ <4> [280.852784] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.852785] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:2/119 <4> [280.852888] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.852955] autofs4 [last unloaded: snd_hda_intel] <4> [280.852959] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.852962] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.852963] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.852965] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.852970] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.853040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.853042] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.853044] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.853046] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.853047] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.853048] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.853050] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.853051] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.853053] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.853054] CR2: 00005adf76351cd8 CR3: 00000001240fe005 CR4: 0000000000f72ef0 <4> [280.853055] PKRU: 55555554 <4> [280.853057] Call Trace: <4> [280.853058] <TASK> <4> [280.853062] ? lock_sync+0x100/0x100 <4> [280.853066] ? lock_release+0xd0/0x2b0 <4> [280.853072] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.853078] process_one_work+0x239/0x760 <4> [280.853084] worker_thread+0x200/0x3f0 <4> [280.853087] ? __pfx_worker_thread+0x10/0x10 <4> [280.853089] kthread+0x10d/0x150 <4> [280.853092] ? __pfx_kthread+0x10/0x10 <4> [280.853096] ret_from_fork+0x3d4/0x480 <4> [280.853098] ? __pfx_kthread+0x10/0x10 <4> [280.853101] ret_from_fork_asm+0x1a/0x30 <4> [280.853109] </TASK> <4> [280.853110] irq event stamp: 468263 <4> [280.853111] hardirqs last enabled at (468269): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.853114] hardirqs last disabled at (468274): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.853116] softirqs last enabled at (464824): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.853119] softirqs last disabled at (464799): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.853121] ---[ end trace 0000000000000000 ]--- <6> [280.853123] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.853193] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.853200] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.853252] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.854344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.854491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.854636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.854791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.854940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.855076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.855219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.855378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.855517] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.855661] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.855863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.858496] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.868701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.869052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.871022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.871111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.871190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.871284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.871365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.871460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.871546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.871656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.871745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.871825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.871923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.872010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.872089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.872174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.872258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.872349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.872437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.872523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.872607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.872693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.872774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.872854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.872936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.873018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.873097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.873175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.873252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.873332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.873412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.873490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.873568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.873647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.873742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.873820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.873897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.873975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.874051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.874125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.874198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.874269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.874342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.874413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.874484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.874553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.874628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.874714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.874795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.874874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.874953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.875026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.875096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.875168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.875238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.875309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.875381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.875458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.875534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.875613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.875702] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.876903] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.876908] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20332, lrc_seqno=20332, guc_id=0, flags=0x73 in no process [-1] <7> [280.876910] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.876974] ------------[ cut here ]------------ <4> [280.876975] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.876977] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:2/119 <4> [280.877049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.877115] autofs4 [last unloaded: snd_hda_intel] <4> [280.877120] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.877123] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.877124] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.877125] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.877131] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.877201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.877203] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.877205] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.877207] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.877209] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.877210] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.877211] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.877213] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.877215] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.877216] CR2: 00005adf76351cd8 CR3: 00000001240fe005 CR4: 0000000000f72ef0 <4> [280.877218] PKRU: 55555554 <4> [280.877220] Call Trace: <4> [280.877221] <TASK> <4> [280.877225] ? lock_sync+0x100/0x100 <4> [280.877230] ? lock_release+0xd0/0x2b0 <4> [280.877235] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.877241] process_one_work+0x239/0x760 <4> [280.877248] worker_thread+0x200/0x3f0 <4> [280.877251] ? __pfx_worker_thread+0x10/0x10 <4> [280.877254] kthread+0x10d/0x150 <4> [280.877257] ? __pfx_kthread+0x10/0x10 <4> [280.877261] ret_from_fork+0x3d4/0x480 <4> [280.877263] ? __pfx_kthread+0x10/0x10 <4> [280.877267] ret_from_fork_asm+0x1a/0x30 <4> [280.877274] </TASK> <4> [280.877275] irq event stamp: 479025 <4> [280.877277] hardirqs last enabled at (479031): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.877280] hardirqs last disabled at (479036): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.877283] softirqs last enabled at (475852): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.877285] softirqs last disabled at (475845): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.877288] ---[ end trace 0000000000000000 ]--- <5> [280.878558] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20387, lrc_seqno=20387, guc_id=0, flags=0x73 in no process [-1] <7> [280.878567] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.878697] ------------[ cut here ]------------ <4> [280.878700] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.878702] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:15/3448 <4> [280.878823] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.878917] autofs4 [last unloaded: snd_hda_intel] <4> [280.878922] CPU: 12 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.878926] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.878928] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.878931] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.878939] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.879056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.879058] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.879062] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.879064] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.879066] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.879068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.879070] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.879072] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [280.879074] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.879076] CR2: 00007b83c8850000 CR3: 00000003987e4005 CR4: 0000000000f72ef0 <4> [280.879078] PKRU: 55555554 <4> [280.879080] Call Trace: <4> [280.879082] <TASK> <4> [280.879088] ? lock_sync+0x100/0x100 <4> [280.879095] ? lock_release+0xd0/0x2b0 <4> [280.879103] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.879113] process_one_work+0x239/0x760 <4> [280.879123] worker_thread+0x200/0x3f0 <4> [280.879128] ? __pfx_worker_thread+0x10/0x10 <4> [280.879131] kthread+0x10d/0x150 <4> [280.879135] ? __pfx_kthread+0x10/0x10 <4> [280.879141] ret_from_fork+0x3d4/0x480 <4> [280.879144] ? __pfx_kthread+0x10/0x10 <4> [280.879149] ret_from_fork_asm+0x1a/0x30 <4> [280.879161] </TASK> <4> [280.879163] irq event stamp: 1432185 <4> [280.879164] hardirqs last enabled at (1432191): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.879169] hardirqs last disabled at (1432196): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.879172] softirqs last enabled at (1429652): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.879175] softirqs last disabled at (1429645): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.879178] ---[ end trace 0000000000000000 ]--- <7> [280.879121] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [280.879181] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.879300] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.879308] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.879269] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.879414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.880428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.880581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.880742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.880894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.881036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.881176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.881315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.881469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.881604] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.881806] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.882018] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.884357] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.894697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.895027] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.896644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.896823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.896926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.897031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.897123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.897211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.897303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.897388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.897486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.897566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.897700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.897829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.897949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.898101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.898214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.898329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.898439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.898553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.898694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.898815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.898933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.899049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.899169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.899287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.899404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.899518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.899632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.899786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.900194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.900304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.900391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.900478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.900621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.900714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.901051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.901146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.901231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.901312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.901392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.901468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.901549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.901628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.901712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.901789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.901869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.901945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.902022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.902102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.902182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.902261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.902339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.902419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.902497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.902575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.902652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.902738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.902816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.902893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.902972] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.904339] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.904345] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20387, lrc_seqno=20387, guc_id=0, flags=0x73 in no process [-1] <7> [280.904348] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.904409] ------------[ cut here ]------------ <4> [280.904410] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.904412] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:15/3448 <4> [280.904485] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.904554] autofs4 [last unloaded: snd_hda_intel] <4> [280.904558] CPU: 10 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.904561] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.904563] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.904564] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.904570] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.904640] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.904642] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.904644] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.904646] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.904647] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.904648] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.904650] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.904651] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [280.904653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.904654] CR2: 00005adf76351cd8 CR3: 000000012943d001 CR4: 0000000000f72ef0 <4> [280.904656] PKRU: 55555554 <4> [280.904657] Call Trace: <4> [280.904658] <TASK> <4> [280.904662] ? lock_sync+0x100/0x100 <4> [280.904667] ? lock_release+0xd0/0x2b0 <4> [280.904673] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.904679] process_one_work+0x239/0x760 <4> [280.904690] worker_thread+0x200/0x3f0 <4> [280.904693] ? __pfx_worker_thread+0x10/0x10 <4> [280.904696] kthread+0x10d/0x150 <4> [280.904699] ? __pfx_kthread+0x10/0x10 <4> [280.904703] ret_from_fork+0x3d4/0x480 <4> [280.904706] ? __pfx_kthread+0x10/0x10 <4> [280.904709] ret_from_fork_asm+0x1a/0x30 <4> [280.904717] </TASK> <4> [280.904719] irq event stamp: 1442961 <4> [280.904720] hardirqs last enabled at (1442967): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.904723] hardirqs last disabled at (1442972): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.904726] softirqs last enabled at (1439764): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.904729] softirqs last disabled at (1439757): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.904731] ---[ end trace 0000000000000000 ]--- <6> [280.905794] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.905877] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.905895] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.905935] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.906058] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.906220] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.906922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.907020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.907121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.907223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.907317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.907407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.907508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.907599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.907682] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.907808] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.907978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.909216] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.919711] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.919996] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.921251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.921336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.921414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.921503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.921588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.921677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.921771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.921884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.921960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.922046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.922134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.922223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.922424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.922515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.922596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.922692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.922810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.922921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.923003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.923088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.923171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.923253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.923334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.923413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.923495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.923577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.923657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.923753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.923852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.923931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.924019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.924105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.924192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.924290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.924384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.924467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.924551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.924630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.924720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.924808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.924887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.924964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.925047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.925127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.925211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.925291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.925370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.925447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.925527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.925605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.925684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.925787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.925878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.925959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.926037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.926117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.926195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.926272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.926353] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.927604] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.927609] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20387, lrc_seqno=20387, guc_id=0, flags=0x73 in no process [-1] <7> [280.927612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.927672] ------------[ cut here ]------------ <4> [280.927673] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.927674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:16/3449 <4> [280.927767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.927855] autofs4 [last unloaded: snd_hda_intel] <4> [280.927860] CPU: 3 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.927863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.927865] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.927866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.927873] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.927945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.927947] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [280.927950] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.927952] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.927953] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.927955] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.927956] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.927958] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [280.927960] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.927962] CR2: 00005adf76340e50 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [280.927964] PKRU: 55555554 <4> [280.927965] Call Trace: <4> [280.927967] <TASK> <4> [280.927971] ? lock_sync+0x100/0x100 <4> [280.927976] ? lock_release+0xd0/0x2b0 <4> [280.927982] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.927988] process_one_work+0x239/0x760 <4> [280.927995] worker_thread+0x200/0x3f0 <4> [280.927998] ? __pfx_worker_thread+0x10/0x10 <4> [280.928001] kthread+0x10d/0x150 <4> [280.928005] ? __pfx_kthread+0x10/0x10 <4> [280.928009] ret_from_fork+0x3d4/0x480 <4> [280.928011] ? __pfx_kthread+0x10/0x10 <4> [280.928015] ret_from_fork_asm+0x1a/0x30 <4> [280.928023] </TASK> <4> [280.928025] irq event stamp: 590843 <4> [280.928026] hardirqs last enabled at (590849): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.928030] hardirqs last disabled at (590854): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.928032] softirqs last enabled at (590100): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.928035] softirqs last disabled at (590095): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.928037] ---[ end trace 0000000000000000 ]--- <7> [280.929789] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.929945] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.930197] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20442, lrc_seqno=20442, guc_id=0, flags=0x73 in no process [-1] <7> [280.930202] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.930268] ------------[ cut here ]------------ <4> [280.930269] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.930271] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:18/3451 <4> [280.930347] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.930417] autofs4 [last unloaded: snd_hda_intel] <4> [280.930421] CPU: 8 UID: 0 PID: 3451 Comm: kworker/u64:18 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.930424] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.930425] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.930427] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.930432] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.930504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.930506] RSP: 0018:ffffc900025bfca0 EFLAGS: 00010246 <4> [280.930509] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.930510] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.930512] RBP: ffffc900025bfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.930513] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.930514] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.930516] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [280.930517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.930519] CR2: 00005adf76351cd8 CR3: 0000000371a8e003 CR4: 0000000000f72ef0 <4> [280.930520] PKRU: 55555554 <4> [280.930521] Call Trace: <4> [280.930523] <TASK> <4> [280.930527] ? lock_sync+0x100/0x100 <4> [280.930532] ? lock_release+0xd0/0x2b0 <4> [280.930537] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.930543] process_one_work+0x239/0x760 <4> [280.930550] worker_thread+0x200/0x3f0 <4> [280.930553] ? __pfx_worker_thread+0x10/0x10 <4> [280.930555] kthread+0x10d/0x150 <4> [280.930558] ? __pfx_kthread+0x10/0x10 <4> [280.930562] ret_from_fork+0x3d4/0x480 <4> [280.930564] ? __pfx_kthread+0x10/0x10 <4> [280.930568] ret_from_fork_asm+0x1a/0x30 <4> [280.930575] </TASK> <4> [280.930577] irq event stamp: 700429 <4> [280.930578] hardirqs last enabled at (700435): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.930581] hardirqs last disabled at (700440): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.930583] softirqs last enabled at (697178): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.930586] softirqs last disabled at (697171): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.930588] ---[ end trace 0000000000000000 ]--- <6> [280.930591] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.930663] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.930670] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.930731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.931786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.931935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.932081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.932228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.932393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.932532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.932673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.932841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.932943] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.933043] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.933193] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.934458] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.944696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.944975] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.946159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.946241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.946313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.946396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.946484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.946571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.946657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.946755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.946839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.946951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.947034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.947120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.947211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.947291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.947380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.947466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.947553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.947640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.947735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.947819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.947904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.947984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.948067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.948148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.948228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.948309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.948388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.948469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.948638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.948726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.949103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.949188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.949280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.949391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.949485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.949572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.949652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.949737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.949815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.949891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.949970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.950049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.950131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.950210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.950293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.950371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.950449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.950526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.950605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.950681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.950769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.950847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.950925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.951003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.951080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.951158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.951237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.951316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.951398] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.952977] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.952983] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20442, lrc_seqno=20442, guc_id=0, flags=0x73 in no process [-1] <7> [280.952985] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.953047] ------------[ cut here ]------------ <4> [280.953048] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.953050] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:18/3451 <4> [280.953122] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.953191] autofs4 [last unloaded: snd_hda_intel] <4> [280.953195] CPU: 7 UID: 0 PID: 3451 Comm: kworker/u64:18 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.953198] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.953200] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.953201] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.953207] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.953276] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.953278] RSP: 0018:ffffc900025bfca0 EFLAGS: 00010246 <4> [280.953280] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.953281] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.953283] RBP: ffffc900025bfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.953284] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.953285] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.953287] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [280.953288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.953290] CR2: 00005adf76351cd8 CR3: 000000012943d005 CR4: 0000000000f72ef0 <4> [280.953291] PKRU: 55555554 <4> [280.953292] Call Trace: <4> [280.953293] <TASK> <4> [280.953297] ? lock_sync+0x100/0x100 <4> [280.953302] ? lock_release+0xd0/0x2b0 <4> [280.953308] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.953313] process_one_work+0x239/0x760 <4> [280.953320] worker_thread+0x200/0x3f0 <4> [280.953323] ? __pfx_worker_thread+0x10/0x10 <4> [280.953325] kthread+0x10d/0x150 <4> [280.953328] ? __pfx_kthread+0x10/0x10 <4> [280.953332] ret_from_fork+0x3d4/0x480 <4> [280.953334] ? __pfx_kthread+0x10/0x10 <4> [280.953338] ret_from_fork_asm+0x1a/0x30 <4> [280.953345] </TASK> <4> [280.953347] irq event stamp: 711101 <4> [280.953348] hardirqs last enabled at (711107): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.953351] hardirqs last disabled at (711112): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.953353] softirqs last enabled at (710204): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.953356] softirqs last disabled at (710199): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.953358] ---[ end trace 0000000000000000 ]--- <6> [280.953360] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.953431] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.953439] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.954612] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.954734] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [280.954843] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.955737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.955887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.956051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.956189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.956329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.956464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.956612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.956777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.956870] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.956975] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.957116] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.958354] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.969069] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.969378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.970864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.970947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.971027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.971105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.971188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.971279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.971364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.971452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.971539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.971627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.971729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.971820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.971910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.971999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.972088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.972181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [280.972554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [280.972640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [280.972737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [280.972821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [280.972930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [280.973025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [280.973108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [280.973190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [280.973272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [280.973353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [280.973431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [280.973511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [280.973695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [280.973799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [280.973894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [280.973978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [280.974070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [280.974160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [280.974273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [280.974366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [280.974450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [280.974533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [280.974615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [280.974698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [280.974781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [280.974860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [280.974938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [280.975016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [280.975100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [280.975195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [280.975276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [280.975354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [280.975434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [280.975511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [280.975589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [280.975673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [280.975769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [280.975849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [280.975926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [280.976006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [280.976084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [280.976165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [280.976248] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [280.977453] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [280.977458] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20442, lrc_seqno=20442, guc_id=0, flags=0x73 in no process [-1] <7> [280.977460] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.977517] ------------[ cut here ]------------ <4> [280.977518] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.977520] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [280.977586] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.977648] autofs4 [last unloaded: snd_hda_intel] <4> [280.977652] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.977655] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.977656] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.977657] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.977662] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.977742] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.977744] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [280.977747] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.977748] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.977750] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.977751] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.977752] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.977754] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [280.977755] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.977757] CR2: 00005adf76356040 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [280.977759] PKRU: 55555554 <4> [280.977761] Call Trace: <4> [280.977762] <TASK> <4> [280.977766] ? lock_sync+0x100/0x100 <4> [280.977771] ? lock_release+0xd0/0x2b0 <4> [280.977777] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.977783] process_one_work+0x239/0x760 <4> [280.977790] worker_thread+0x200/0x3f0 <4> [280.977793] ? __pfx_worker_thread+0x10/0x10 <4> [280.977796] kthread+0x10d/0x150 <4> [280.977799] ? __pfx_kthread+0x10/0x10 <4> [280.977803] ret_from_fork+0x3d4/0x480 <4> [280.977805] ? __pfx_kthread+0x10/0x10 <4> [280.977809] ret_from_fork_asm+0x1a/0x30 <4> [280.977817] </TASK> <4> [280.977818] irq event stamp: 496491 <4> [280.977819] hardirqs last enabled at (496497): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.977823] hardirqs last disabled at (496502): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.977825] softirqs last enabled at (496330): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.977828] softirqs last disabled at (496325): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.977831] ---[ end trace 0000000000000000 ]--- <7> [280.979208] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [280.979351] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [280.980724] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20497, lrc_seqno=20497, guc_id=0, flags=0x73 in no process [-1] <7> [280.980731] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [280.980828] ------------[ cut here ]------------ <4> [280.980830] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [280.980833] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:15/3448 <4> [280.980933] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [280.981045] autofs4 [last unloaded: snd_hda_intel] <4> [280.981053] CPU: 10 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [280.981057] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [280.981059] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [280.981061] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [280.981070] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [280.981167] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [280.981170] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [280.981175] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [280.981177] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [280.981179] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [280.981181] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [280.981182] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [280.981184] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [280.981187] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [280.981189] CR2: 00005adf76340e50 CR3: 000000037141c001 CR4: 0000000000f72ef0 <4> [280.981192] PKRU: 55555554 <4> [280.981194] Call Trace: <4> [280.981197] <TASK> <4> [280.981203] ? lock_sync+0x100/0x100 <4> [280.981211] ? lock_release+0xd0/0x2b0 <4> [280.981221] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [280.981230] process_one_work+0x239/0x760 <4> [280.981241] worker_thread+0x200/0x3f0 <4> [280.981246] ? __pfx_worker_thread+0x10/0x10 <4> [280.981250] kthread+0x10d/0x150 <4> [280.981255] ? __pfx_kthread+0x10/0x10 <4> [280.981261] ret_from_fork+0x3d4/0x480 <4> [280.981265] ? __pfx_kthread+0x10/0x10 <4> [280.981270] ret_from_fork_asm+0x1a/0x30 <4> [280.981284] </TASK> <4> [280.981286] irq event stamp: 1446665 <4> [280.981288] hardirqs last enabled at (1446671): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [280.981294] hardirqs last disabled at (1446676): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [280.981297] softirqs last enabled at (1445872): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.981301] softirqs last disabled at (1445831): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [280.981305] ---[ end trace 0000000000000000 ]--- <6> [280.981309] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [280.981408] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [280.981422] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [280.981478] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [280.982531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [280.982636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [280.982746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [280.982847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [280.983000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [280.983151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [280.983284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [280.983424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [280.983557] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [280.983658] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [280.983835] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [280.985227] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [280.995696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [280.996013] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [280.997559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [280.997666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [280.997767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [280.998019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [280.998158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [280.998355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [280.998505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [280.998634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [280.998779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [280.998948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [280.999117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [280.999253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [280.999512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [280.999681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [280.999854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [280.999986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.000411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.000573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.000693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.000779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.000863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.000972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.001097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.001223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.001356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.001479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.001599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.001699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.002077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.002249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.002389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.002529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.002705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.002925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.003026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.003123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.003211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.003293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.003401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.003521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.003646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.003797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.003925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.004046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.004160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.004242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.004323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.004406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.004488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.004575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.004699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.004826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.004945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.005066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.005190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.005311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.005395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.005473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.005555] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.007744] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.007752] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20497, lrc_seqno=20497, guc_id=0, flags=0x73 in no process [-1] <7> [281.007755] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.007857] ------------[ cut here ]------------ <4> [281.007858] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.007860] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:18/3451 <4> [281.007931] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.008000] autofs4 [last unloaded: snd_hda_intel] <4> [281.008004] CPU: 7 UID: 0 PID: 3451 Comm: kworker/u64:18 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.008008] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.008009] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.008011] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.008016] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.008087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.008089] RSP: 0018:ffffc900025bfca0 EFLAGS: 00010246 <4> [281.008092] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.008093] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.008094] RBP: ffffc900025bfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.008096] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.008097] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.008098] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [281.008100] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.008101] CR2: 00005adf76351cd8 CR3: 00000003523c1001 CR4: 0000000000f72ef0 <4> [281.008103] PKRU: 55555554 <4> [281.008104] Call Trace: <4> [281.008105] <TASK> <4> [281.008109] ? lock_sync+0x100/0x100 <4> [281.008114] ? lock_release+0xd0/0x2b0 <4> [281.008120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.008126] process_one_work+0x239/0x760 <4> [281.008132] worker_thread+0x200/0x3f0 <4> [281.008135] ? __pfx_worker_thread+0x10/0x10 <4> [281.008138] kthread+0x10d/0x150 <4> [281.008141] ? __pfx_kthread+0x10/0x10 <4> [281.008144] ret_from_fork+0x3d4/0x480 <4> [281.008147] ? __pfx_kthread+0x10/0x10 <4> [281.008150] ret_from_fork_asm+0x1a/0x30 <4> [281.008158] </TASK> <4> [281.008159] irq event stamp: 724125 <4> [281.008160] hardirqs last enabled at (724131): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.008163] hardirqs last disabled at (724136): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.008165] softirqs last enabled at (720834): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.008168] softirqs last disabled at (720827): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.008170] ---[ end trace 0000000000000000 ]--- <6> [281.008172] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.008245] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.008253] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.009480] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.009638] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.009838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.010786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.010908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.011035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.011162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.011280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.011401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.011510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.011637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.011765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.011890] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.012081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.013500] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.023698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.024011] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.025619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.025741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.025913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.026368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.026639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.026957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.027156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.027496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.027631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.027780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.027914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.028048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.028257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.028368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.028696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.029514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.029655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.029902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.030040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.030161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.030283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.030400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.030519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.030636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.030787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.030933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.031063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.031193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.031328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.031473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.031631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.031775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.031876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.031980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.032083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.032168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.032252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.032332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.032412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.032490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.032571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.032651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.032744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.032821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.032908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.032989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.033069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.033147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.033226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.033303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.033380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.033460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.033536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.033612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.033693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.033803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.033895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.033974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.034057] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.035391] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.035396] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20497, lrc_seqno=20497, guc_id=0, flags=0x73 in no process [-1] <7> [281.035399] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.035458] ------------[ cut here ]------------ <4> [281.035460] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.035461] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:16/3449 <4> [281.035534] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.035601] autofs4 [last unloaded: snd_hda_intel] <4> [281.035606] CPU: 6 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.035609] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.035610] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.035612] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.035617] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.035712] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.035714] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.035716] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.035718] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.035719] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.035720] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.035721] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.035723] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [281.035725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.035726] CR2: 00005adf76356040 CR3: 00000001240fe006 CR4: 0000000000f72ef0 <4> [281.035728] PKRU: 55555554 <4> [281.035729] Call Trace: <4> [281.035731] <TASK> <4> [281.035735] ? lock_sync+0x100/0x100 <4> [281.035741] ? lock_release+0xd0/0x2b0 <4> [281.035747] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.035752] process_one_work+0x239/0x760 <4> [281.035760] worker_thread+0x200/0x3f0 <4> [281.035763] ? __pfx_worker_thread+0x10/0x10 <4> [281.035765] kthread+0x10d/0x150 <4> [281.035769] ? __pfx_kthread+0x10/0x10 <4> [281.035773] ret_from_fork+0x3d4/0x480 <4> [281.035775] ? __pfx_kthread+0x10/0x10 <4> [281.035779] ret_from_fork_asm+0x1a/0x30 <4> [281.035787] </TASK> <4> [281.035788] irq event stamp: 608845 <4> [281.035790] hardirqs last enabled at (608851): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.035793] hardirqs last disabled at (608856): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.035795] softirqs last enabled at (608684): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.035798] softirqs last disabled at (608613): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.035801] ---[ end trace 0000000000000000 ]--- <7> [281.037506] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.037655] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [281.038536] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20552, lrc_seqno=20552, guc_id=0, flags=0x73 in no process [-1] <7> [281.038544] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.038622] ------------[ cut here ]------------ <4> [281.038624] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.038625] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:2/119 <4> [281.038709] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.038787] autofs4 [last unloaded: snd_hda_intel] <4> [281.038792] CPU: 0 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.038795] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.038796] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.038798] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.038803] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.038879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.038881] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [281.038883] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.038884] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.038886] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.038887] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.038888] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.038889] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [281.038891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.038892] CR2: 00007b83c21e8000 CR3: 00000003714ed002 CR4: 0000000000f72ef0 <4> [281.038894] PKRU: 55555554 <4> [281.038895] Call Trace: <4> [281.038896] <TASK> <4> [281.038900] ? lock_sync+0x100/0x100 <4> [281.038905] ? lock_release+0xd0/0x2b0 <4> [281.038911] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.038917] process_one_work+0x239/0x760 <4> [281.038924] worker_thread+0x200/0x3f0 <4> [281.038927] ? __pfx_worker_thread+0x10/0x10 <4> [281.038930] kthread+0x10d/0x150 <4> [281.038933] ? __pfx_kthread+0x10/0x10 <4> [281.038937] ret_from_fork+0x3d4/0x480 <4> [281.038939] ? __pfx_kthread+0x10/0x10 <4> [281.038943] ret_from_fork_asm+0x1a/0x30 <4> [281.038951] </TASK> <4> [281.038952] irq event stamp: 498273 <4> [281.038953] hardirqs last enabled at (498279): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.038957] hardirqs last disabled at (498284): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.038959] softirqs last enabled at (497530): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.038962] softirqs last disabled at (497523): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.038965] ---[ end trace 0000000000000000 ]--- <6> [281.038967] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.039038] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.039046] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.039105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.039740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.039851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.039948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.040041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.040132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.040221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.040310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.040399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.040483] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.040581] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.040716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.041793] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.051699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.051981] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.053204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.053288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.053367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.053446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.053539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.053615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.053714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.053826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.053910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.054005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.054082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.054170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.054245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.054339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.054416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.054506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.054581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.054655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.055156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.055259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.055341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.055421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.055506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.055587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.055666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.055755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.055849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.055931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.056030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.056118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.056213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.056309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.056406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.056503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.056598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.056696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.056801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.056886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.056968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.057046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.057128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.057208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.057287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.057364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.057444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.057523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.057601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.057678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.057775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.057878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.057958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.058040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.058118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.058198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.058276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.058355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.058432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.058509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.058590] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.060003] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.060009] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20552, lrc_seqno=20552, guc_id=0, flags=0x73 in no process [-1] <7> [281.060012] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.060116] ------------[ cut here ]------------ <4> [281.060117] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.060118] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:2/119 <4> [281.060192] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.060260] autofs4 [last unloaded: snd_hda_intel] <4> [281.060264] CPU: 3 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.060268] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.060269] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.060270] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.060276] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.060347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.060348] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [281.060351] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.060352] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.060354] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.060355] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.060356] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.060357] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.060359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.060360] CR2: 00007b83c21d8000 CR3: 00000001159e6001 CR4: 0000000000f72ef0 <4> [281.060362] PKRU: 55555554 <4> [281.060363] Call Trace: <4> [281.060364] <TASK> <4> [281.060368] ? lock_sync+0x100/0x100 <4> [281.060373] ? lock_release+0xd0/0x2b0 <4> [281.060379] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.060385] process_one_work+0x239/0x760 <4> [281.060391] worker_thread+0x200/0x3f0 <4> [281.060394] ? __pfx_worker_thread+0x10/0x10 <4> [281.060397] kthread+0x10d/0x150 <4> [281.060400] ? __pfx_kthread+0x10/0x10 <4> [281.060403] ret_from_fork+0x3d4/0x480 <4> [281.060406] ? __pfx_kthread+0x10/0x10 <4> [281.060409] ret_from_fork_asm+0x1a/0x30 <4> [281.060416] </TASK> <4> [281.060418] irq event stamp: 508967 <4> [281.060419] hardirqs last enabled at (508973): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.060422] hardirqs last disabled at (508978): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.060424] softirqs last enabled at (505406): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.060427] softirqs last disabled at (505397): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.060429] ---[ end trace 0000000000000000 ]--- <6> [281.060431] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.060502] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.060510] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.061564] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.061673] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.061917] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.062544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.062637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.062768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.062863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.062953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.063039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.063130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.063222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.063308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.063404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.063536] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.064690] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.074695] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.074953] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.076228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.076310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.076387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.076476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.076566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.076655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.076747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.076853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.076929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.077012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.077096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.077177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.077268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.077358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.077450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.077541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.077636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.077921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.078019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.078102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.078184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.078264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.078345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.078423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.078501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.078580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.078658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.078763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.078867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.078953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.079035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.079118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.079215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.079313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.079411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.079494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.079576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.079657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.079747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.079843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.079924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.080010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.080093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.080171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.080254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.080332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.080411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.080491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.080575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.080655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.080749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.080845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.080925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.081006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.081086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.081168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.081245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.081324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.081404] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.083537] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.083543] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20552, lrc_seqno=20552, guc_id=0, flags=0x73 in no process [-1] <7> [281.083546] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.083613] ------------[ cut here ]------------ <4> [281.083614] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.083615] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:15/3448 <4> [281.083694] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.083793] autofs4 [last unloaded: snd_hda_intel] <4> [281.083798] CPU: 3 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.083801] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.083803] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.083805] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.083811] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.083885] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.083887] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [281.083889] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.083891] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.083893] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.083895] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.083896] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.083898] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.083900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.083901] CR2: 00007b83c21d8000 CR3: 00000001159e6001 CR4: 0000000000f72ef0 <4> [281.083903] PKRU: 55555554 <4> [281.083905] Call Trace: <4> [281.083907] <TASK> <4> [281.083911] ? lock_sync+0x100/0x100 <4> [281.083916] ? lock_release+0xd0/0x2b0 <4> [281.083922] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.083928] process_one_work+0x239/0x760 <4> [281.083935] worker_thread+0x200/0x3f0 <4> [281.083938] ? __pfx_worker_thread+0x10/0x10 <4> [281.083941] kthread+0x10d/0x150 <4> [281.083945] ? __pfx_kthread+0x10/0x10 <4> [281.083948] ret_from_fork+0x3d4/0x480 <4> [281.083951] ? __pfx_kthread+0x10/0x10 <4> [281.083954] ret_from_fork_asm+0x1a/0x30 <4> [281.083962] </TASK> <4> [281.083963] irq event stamp: 1461009 <4> [281.083964] hardirqs last enabled at (1461015): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.083968] hardirqs last disabled at (1461020): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.083970] softirqs last enabled at (1457696): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.083973] softirqs last disabled at (1457689): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.083975] ---[ end trace 0000000000000000 ]--- <7> [281.084714] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.084843] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [281.086129] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20607, lrc_seqno=20607, guc_id=0, flags=0x73 in no process [-1] <7> [281.086134] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.086240] ------------[ cut here ]------------ <4> [281.086243] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.086246] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:15/3448 <4> [281.086349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.086464] autofs4 [last unloaded: snd_hda_intel] <4> [281.086468] CPU: 2 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.086471] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.086473] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.086474] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.086480] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.086554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.086556] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [281.086559] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.086560] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.086562] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.086563] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.086564] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.086565] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.086567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.086568] CR2: 00007b83c8850000 CR3: 000000011e4d6004 CR4: 0000000000f72ef0 <4> [281.086570] PKRU: 55555554 <4> [281.086571] Call Trace: <4> [281.086572] <TASK> <4> [281.086576] ? lock_sync+0x100/0x100 <4> [281.086581] ? lock_release+0xd0/0x2b0 <4> [281.086587] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.086593] process_one_work+0x239/0x760 <4> [281.086600] worker_thread+0x200/0x3f0 <4> [281.086602] ? __pfx_worker_thread+0x10/0x10 <4> [281.086605] kthread+0x10d/0x150 <4> [281.086608] ? __pfx_kthread+0x10/0x10 <4> [281.086612] ret_from_fork+0x3d4/0x480 <4> [281.086614] ? __pfx_kthread+0x10/0x10 <4> [281.086617] ret_from_fork_asm+0x1a/0x30 <4> [281.086625] </TASK> <4> [281.086626] irq event stamp: 1462693 <4> [281.086627] hardirqs last enabled at (1462699): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.086631] hardirqs last disabled at (1462704): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.086633] softirqs last enabled at (1461546): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.086635] softirqs last disabled at (1461541): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.086638] ---[ end trace 0000000000000000 ]--- <6> [281.086640] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.086757] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.086771] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.086880] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.087763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.087908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.088052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.088189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.088332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.088478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.088624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.088784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.088878] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.088976] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.089107] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.090318] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.100696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.100965] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.102391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.102485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.102566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.102672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.102825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.102970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.103103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.103250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.103482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.103597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.103724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.103900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.104015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.104130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.104314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.104448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.104616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.104785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.104884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.104971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.105056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.105138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.105221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.105301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.105381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.105461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.105544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.105627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.105728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.105836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.105940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.106031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.106179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.106296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.106409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.106696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.106779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.106858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.106938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.107014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.107095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.107173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.107251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.107328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.107409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.107486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.107564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.107641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.107729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.107810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.107890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.107972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.108050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.108129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.108206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.108285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.108361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.108436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.108516] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.109918] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.109924] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20607, lrc_seqno=20607, guc_id=0, flags=0x73 in no process [-1] <7> [281.109926] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.109987] ------------[ cut here ]------------ <4> [281.109988] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.109989] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3449 <4> [281.110094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.110164] autofs4 [last unloaded: snd_hda_intel] <4> [281.110168] CPU: 2 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.110171] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.110172] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.110174] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.110180] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.110249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.110251] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.110253] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.110254] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.110256] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.110257] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.110258] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.110260] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.110261] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.110262] CR2: 00007b83c8850000 CR3: 000000012943d006 CR4: 0000000000f72ef0 <4> [281.110264] PKRU: 55555554 <4> [281.110265] Call Trace: <4> [281.110266] <TASK> <4> [281.110270] ? lock_sync+0x100/0x100 <4> [281.110275] ? lock_release+0xd0/0x2b0 <4> [281.110281] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.110287] process_one_work+0x239/0x760 <4> [281.110294] worker_thread+0x200/0x3f0 <4> [281.110297] ? __pfx_worker_thread+0x10/0x10 <4> [281.110299] kthread+0x10d/0x150 <4> [281.110302] ? __pfx_kthread+0x10/0x10 <4> [281.110306] ret_from_fork+0x3d4/0x480 <4> [281.110308] ? __pfx_kthread+0x10/0x10 <4> [281.110311] ret_from_fork_asm+0x1a/0x30 <4> [281.110319] </TASK> <4> [281.110320] irq event stamp: 624589 <4> [281.110321] hardirqs last enabled at (624595): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.110325] hardirqs last disabled at (624600): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.110327] softirqs last enabled at (623476): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.110330] softirqs last disabled at (623471): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.110332] ---[ end trace 0000000000000000 ]--- <6> [281.110334] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.110406] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.110412] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.110476] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.111185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.111276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.111381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.111477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.111564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.111654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.111770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.111865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.111953] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.112051] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.112179] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.113411] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.123694] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.123985] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.125488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.125569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.125646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.125751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.125841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.125932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.126378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.126461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.126555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.126637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.126759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.126846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.126993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.127076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.127161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.127257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.127338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.127421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.127539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.127622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.127712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.127807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.127891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.127970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.128047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.128123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.128200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.128282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.128391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.128565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.128675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.128790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.128906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.129029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.129136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.129229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.129309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.129389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.129466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.129543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.129624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.129711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.129801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.129883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.129966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.130045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.130124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.130202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.130280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.130356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.130432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.130513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.130589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.130665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.130755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.130845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.130920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.130996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.131076] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.132464] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.132469] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20607, lrc_seqno=20607, guc_id=0, flags=0x73 in no process [-1] <7> [281.132472] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.132533] ------------[ cut here ]------------ <4> [281.132534] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.132535] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3449 <4> [281.132607] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.132673] autofs4 [last unloaded: snd_hda_intel] <4> [281.132678] CPU: 2 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.132681] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.132682] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.132683] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.132710] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.132792] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.132794] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.132797] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.132798] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.132800] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.132801] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.132803] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.132805] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.132807] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.132808] CR2: 00007b83c8850000 CR3: 000000012943d006 CR4: 0000000000f72ef0 <4> [281.132810] PKRU: 55555554 <4> [281.132812] Call Trace: <4> [281.132813] <TASK> <4> [281.132817] ? lock_sync+0x100/0x100 <4> [281.132822] ? lock_release+0xd0/0x2b0 <4> [281.132828] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.132834] process_one_work+0x239/0x760 <4> [281.132841] worker_thread+0x200/0x3f0 <4> [281.132844] ? __pfx_worker_thread+0x10/0x10 <4> [281.132847] kthread+0x10d/0x150 <4> [281.132850] ? __pfx_kthread+0x10/0x10 <4> [281.132854] ret_from_fork+0x3d4/0x480 <4> [281.132857] ? __pfx_kthread+0x10/0x10 <4> [281.132860] ret_from_fork_asm+0x1a/0x30 <4> [281.132868] </TASK> <4> [281.132869] irq event stamp: 635285 <4> [281.132871] hardirqs last enabled at (635291): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.132874] hardirqs last disabled at (635296): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.132876] softirqs last enabled at (635112): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.132879] softirqs last disabled at (635081): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.132882] ---[ end trace 0000000000000000 ]--- <5> [281.133915] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20662, lrc_seqno=20662, guc_id=0, flags=0x73 in no process [-1] <7> [281.133922] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.134009] ------------[ cut here ]------------ <4> [281.134011] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.134014] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3449 <4> [281.134107] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec <7> [281.134058] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [281.134124] rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [281.134213] CPU: 0 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.134218] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.134220] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.134222] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [281.134192] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [281.134229] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.134320] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.134323] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.134336] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.134339] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.134341] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.134343] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.134346] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.134348] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [281.134351] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.134353] CR2: 00005adf76356040 CR3: 000000015405a003 CR4: 0000000000f72ef0 <4> [281.134356] PKRU: 55555554 <4> [281.134358] Call Trace: <4> [281.134360] <TASK> <4> [281.134368] ? lock_sync+0x100/0x100 <4> [281.134376] ? lock_release+0xd0/0x2b0 <4> [281.134387] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.134393] process_one_work+0x239/0x760 <4> [281.134400] worker_thread+0x200/0x3f0 <4> [281.134403] ? __pfx_worker_thread+0x10/0x10 <4> [281.134406] kthread+0x10d/0x150 <4> [281.134410] ? __pfx_kthread+0x10/0x10 <4> [281.134422] ret_from_fork+0x3d4/0x480 <4> [281.134425] ? __pfx_kthread+0x10/0x10 <4> [281.134431] ret_from_fork_asm+0x1a/0x30 <4> [281.134445] </TASK> <4> [281.134447] irq event stamp: 638391 <4> [281.134449] hardirqs last enabled at (638397): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.134453] hardirqs last disabled at (638402): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.134457] softirqs last enabled at (636942): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.134464] softirqs last disabled at (636927): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.134467] ---[ end trace 0000000000000000 ]--- <6> [281.134469] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.134553] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.134563] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.134623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.135890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.136030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.136163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.136285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.136410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.136536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.136664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.136806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.136920] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.137049] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.137227] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.138590] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.148704] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.149064] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.150717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.150825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.150928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.151054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.151175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.151299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.151418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.151532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.151653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.151779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.151900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.152017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.152135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.152252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.152381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.152539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.152660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.152853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.153045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.153133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.153220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.153305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.153388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.153467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.153544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.153621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.153706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.153788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.153956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.154062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.154146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.154226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.154476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.154603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.155009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.155165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.155247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.155331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.155413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.155491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.155572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.155652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.155741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.155819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.155901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.155980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.156059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.156141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.156223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.156302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.156381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.156460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.156539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.156617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.156704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.156784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.156861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.156937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.157017] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.158870] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.158876] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20662, lrc_seqno=20662, guc_id=0, flags=0x73 in no process [-1] <7> [281.158879] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.158943] ------------[ cut here ]------------ <4> [281.158944] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.158946] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:25/5329 <4> [281.159020] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.159088] autofs4 [last unloaded: snd_hda_intel] <4> [281.159092] CPU: 2 UID: 0 PID: 5329 Comm: kworker/u64:25 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.159095] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.159096] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.159098] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.159103] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.159174] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.159176] RSP: 0000:ffffc90004383ca0 EFLAGS: 00010246 <4> [281.159178] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.159179] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.159181] RBP: ffffc90004383db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.159182] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.159183] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.159184] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.159186] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.159187] CR2: 00007b83c8850000 CR3: 000000012943d004 CR4: 0000000000f72ef0 <4> [281.159189] PKRU: 55555554 <4> [281.159190] Call Trace: <4> [281.159191] <TASK> <4> [281.159195] ? lock_sync+0x100/0x100 <4> [281.159200] ? lock_release+0xd0/0x2b0 <4> [281.159206] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.159211] process_one_work+0x239/0x760 <4> [281.159218] worker_thread+0x200/0x3f0 <4> [281.159221] ? __pfx_worker_thread+0x10/0x10 <4> [281.159223] kthread+0x10d/0x150 <4> [281.159226] ? __pfx_kthread+0x10/0x10 <4> [281.159230] ret_from_fork+0x3d4/0x480 <4> [281.159232] ? __pfx_kthread+0x10/0x10 <4> [281.159235] ret_from_fork_asm+0x1a/0x30 <4> [281.159243] </TASK> <4> [281.159244] irq event stamp: 250119 <4> [281.159245] hardirqs last enabled at (250125): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.159248] hardirqs last disabled at (250130): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.159251] softirqs last enabled at (246920): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.159253] softirqs last disabled at (246915): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.159256] ---[ end trace 0000000000000000 ]--- <6> [281.159257] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.159328] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [281.159337] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=28, flags=0x0 in xe_compute_pree [7500] <7> [281.159339] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [281.159449] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.160706] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.160818] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.160929] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.161665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.161783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.161883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.161974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.162061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.162174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.162275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.162370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.162464] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.162561] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.162716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.164025] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.174701] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.174994] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.176265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.176349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.176426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.176607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.176767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.176950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.177073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.177621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.177725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.177822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.177929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.178069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.178465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.178567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.178692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.179055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.179158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.179240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.179316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.179400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.179482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.179561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.179644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.179738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.179818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.179928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.180006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.180085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.180240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.180336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.180558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.180666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.180863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.180978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.181087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.181195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.181274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.181351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.181428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.181504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.181584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.181662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.181757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.181837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.181922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.182001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.182082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.182180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.182275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.182366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.182445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.182526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.182605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.182693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.182775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.182855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.182933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.183010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.183090] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.184603] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.184609] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20662, lrc_seqno=20662, guc_id=0, flags=0x73 in no process [-1] <7> [281.184612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.184740] ------------[ cut here ]------------ <4> [281.184742] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.184743] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:23/3456 <4> [281.184815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.184895] autofs4 [last unloaded: snd_hda_intel] <4> [281.184901] CPU: 3 UID: 0 PID: 3456 Comm: kworker/u64:23 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.184904] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.184905] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.184907] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.184913] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.184985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.184987] RSP: 0018:ffffc900025d7ca0 EFLAGS: 00010246 <4> [281.184990] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.184992] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.184993] RBP: ffffc900025d7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.184995] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.184996] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.184998] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.185000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.185002] CR2: 00005adf76340e50 CR3: 0000000116ee8004 CR4: 0000000000f72ef0 <4> [281.185004] PKRU: 55555554 <4> [281.185005] Call Trace: <4> [281.185007] <TASK> <4> [281.185011] ? lock_sync+0x100/0x100 <4> [281.185017] ? lock_release+0xd0/0x2b0 <4> [281.185023] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.185029] process_one_work+0x239/0x760 <4> [281.185036] worker_thread+0x200/0x3f0 <4> [281.185040] ? __pfx_worker_thread+0x10/0x10 <4> [281.185042] kthread+0x10d/0x150 <4> [281.185046] ? __pfx_kthread+0x10/0x10 <4> [281.185050] ret_from_fork+0x3d4/0x480 <4> [281.185053] ? __pfx_kthread+0x10/0x10 <4> [281.185057] ret_from_fork_asm+0x1a/0x30 <4> [281.185065] </TASK> <4> [281.185066] irq event stamp: 1121225 <4> [281.185068] hardirqs last enabled at (1121231): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.185071] hardirqs last disabled at (1121236): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.185073] softirqs last enabled at (1118020): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.185077] softirqs last disabled at (1118013): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.185080] ---[ end trace 0000000000000000 ]--- <7> [281.187264] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.187390] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [281.187492] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20717, lrc_seqno=20717, guc_id=0, flags=0x73 in no process [-1] <7> [281.187495] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.187557] ------------[ cut here ]------------ <4> [281.187558] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.187560] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:11/210 <4> [281.187634] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.187716] autofs4 [last unloaded: snd_hda_intel] <4> [281.187722] CPU: 3 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.187725] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.187726] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.187728] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.187734] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.187813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.187815] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.187818] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.187820] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.187822] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.187824] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.187825] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.187827] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.187829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.187831] CR2: 00005adf76340e50 CR3: 000000035208b006 CR4: 0000000000f72ef0 <4> [281.187833] PKRU: 55555554 <4> [281.187834] Call Trace: <4> [281.187837] <TASK> <4> [281.187841] ? lock_sync+0x100/0x100 <4> [281.187846] ? lock_release+0xd0/0x2b0 <4> [281.187852] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.187859] process_one_work+0x239/0x760 <4> [281.187866] worker_thread+0x200/0x3f0 <4> [281.187870] ? __pfx_worker_thread+0x10/0x10 <4> [281.187872] kthread+0x10d/0x150 <4> [281.187876] ? __pfx_kthread+0x10/0x10 <4> [281.187880] ret_from_fork+0x3d4/0x480 <4> [281.187882] ? __pfx_kthread+0x10/0x10 <4> [281.187887] ret_from_fork_asm+0x1a/0x30 <4> [281.187895] </TASK> <4> [281.187896] irq event stamp: 682299 <4> [281.187898] hardirqs last enabled at (682305): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.187902] hardirqs last disabled at (682310): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.187904] softirqs last enabled at (681914): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.187908] softirqs last disabled at (681909): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.187911] ---[ end trace 0000000000000000 ]--- <6> [281.187914] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.187987] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.187996] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.188111] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.189270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.189400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.189496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.189635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.189736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.189824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.189917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.190002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.190084] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.190206] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.190419] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.191699] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.201697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.202001] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.203740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.203829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.203907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.203992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.204075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.204181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.204324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.204429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.204572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.204692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.204790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.204946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.205067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.205142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.205351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.205460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.205579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.205657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.205749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.205832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.205915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.205995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.206077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.206157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.206238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.206320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.206402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.206518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.206660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.206782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.206866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.206992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.207348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.207475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.207691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.207811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.207894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.207973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.208051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.208129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.208211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.208290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.208369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.208447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.208528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.208610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.208696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.208776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.208856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.208935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.209017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.209102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.209183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.209264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.209342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.209421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.209499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.209606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.209717] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.211185] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.211189] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20717, lrc_seqno=20717, guc_id=0, flags=0x73 in no process [-1] <7> [281.211191] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.211258] ------------[ cut here ]------------ <4> [281.211259] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.211260] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:11/210 <4> [281.211379] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.211446] autofs4 [last unloaded: snd_hda_intel] <4> [281.211450] CPU: 3 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.211453] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.211454] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.211456] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.211461] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.211532] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.211534] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.211536] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.211537] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.211539] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.211540] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.211541] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.211543] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.211544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.211546] CR2: 00005adf76340e50 CR3: 000000035208b006 CR4: 0000000000f72ef0 <4> [281.211547] PKRU: 55555554 <4> [281.211548] Call Trace: <4> [281.211549] <TASK> <4> [281.211554] ? lock_sync+0x100/0x100 <4> [281.211559] ? lock_release+0xd0/0x2b0 <4> [281.211565] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.211570] process_one_work+0x239/0x760 <4> [281.211577] worker_thread+0x200/0x3f0 <4> [281.211580] ? __pfx_worker_thread+0x10/0x10 <4> [281.211582] kthread+0x10d/0x150 <4> [281.211585] ? __pfx_kthread+0x10/0x10 <4> [281.211589] ret_from_fork+0x3d4/0x480 <4> [281.211592] ? __pfx_kthread+0x10/0x10 <4> [281.211595] ret_from_fork_asm+0x1a/0x30 <4> [281.211602] </TASK> <4> [281.211604] irq event stamp: 692979 <4> [281.211605] hardirqs last enabled at (692985): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.211608] hardirqs last disabled at (692990): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.211610] softirqs last enabled at (689590): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.211613] softirqs last disabled at (689583): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.211615] ---[ end trace 0000000000000000 ]--- <6> [281.211617] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.212849] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.212856] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.213020] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.213179] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.213310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.214015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.214112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.214216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.214311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.214412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.214506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.214604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.214702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.214805] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.214924] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.215107] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.216413] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.226707] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.227028] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.228777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.228861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.228939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.229166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.229274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.229368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.229466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.229695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.229884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.229967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.230464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.230550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.230628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.230743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.230926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.231096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.231480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.231599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.231692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.231775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.231857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.231937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.232018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.232097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.232179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.232261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.232342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.232425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.232612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.232732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.233279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.233461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.233676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.234085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.234425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.234611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.234697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.234777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.234857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.234939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.235023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.235104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.235183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.235259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.235342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.235419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.235501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.235583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.235664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.235753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.235831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.235912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.235992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.236075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.236156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.236237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.236315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.236393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.236474] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.237739] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.237744] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20717, lrc_seqno=20717, guc_id=0, flags=0x73 in no process [-1] <7> [281.237747] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.237811] ------------[ cut here ]------------ <4> [281.237812] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.237813] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:11/210 <4> [281.237886] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.237954] autofs4 [last unloaded: snd_hda_intel] <4> [281.237959] CPU: 3 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.237962] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.237963] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.237964] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.237970] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.238040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.238042] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.238044] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.238046] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.238047] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.238048] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.238049] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.238051] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.238052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.238054] CR2: 00005adf76340e50 CR3: 000000035208b006 CR4: 0000000000f72ef0 <4> [281.238055] PKRU: 55555554 <4> [281.238056] Call Trace: <4> [281.238058] <TASK> <4> [281.238062] ? lock_sync+0x100/0x100 <4> [281.238067] ? lock_release+0xd0/0x2b0 <4> [281.238073] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.238078] process_one_work+0x239/0x760 <4> [281.238085] worker_thread+0x200/0x3f0 <4> [281.238088] ? __pfx_worker_thread+0x10/0x10 <4> [281.238090] kthread+0x10d/0x150 <4> [281.238093] ? __pfx_kthread+0x10/0x10 <4> [281.238097] ret_from_fork+0x3d4/0x480 <4> [281.238099] ? __pfx_kthread+0x10/0x10 <4> [281.238103] ret_from_fork_asm+0x1a/0x30 <4> [281.238111] </TASK> <4> [281.238112] irq event stamp: 703721 <4> [281.238114] hardirqs last enabled at (703727): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.238117] hardirqs last disabled at (703732): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.238120] softirqs last enabled at (700804): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.238123] softirqs last disabled at (700797): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.238125] ---[ end trace 0000000000000000 ]--- <5> [281.240070] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20772, lrc_seqno=20772, guc_id=0, flags=0x73 in no process [-1] <7> [281.240083] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.240360] ------------[ cut here ]------------ <4> [281.240361] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.240363] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:11/210 <4> [281.240446] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate <7> [281.240445] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [281.240519] snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [281.240565] CPU: 2 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.240569] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.240571] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.240573] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.240582] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <7> [281.240595] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [281.240707] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.240709] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.240713] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.240715] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.240717] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.240719] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.240721] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.240723] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.240725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.240727] CR2: 00007b83c8850000 CR3: 000000012c600001 CR4: 0000000000f72ef0 <4> [281.240730] PKRU: 55555554 <4> [281.240731] Call Trace: <4> [281.240733] <TASK> <4> [281.240740] ? lock_sync+0x100/0x100 <4> [281.240749] ? lock_release+0xd0/0x2b0 <4> [281.240762] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.240769] process_one_work+0x239/0x760 <4> [281.240776] worker_thread+0x200/0x3f0 <4> [281.240779] ? __pfx_worker_thread+0x10/0x10 <4> [281.240782] kthread+0x10d/0x150 <4> [281.240786] ? __pfx_kthread+0x10/0x10 <4> [281.240790] ret_from_fork+0x3d4/0x480 <4> [281.240792] ? __pfx_kthread+0x10/0x10 <4> [281.240796] ret_from_fork_asm+0x1a/0x30 <4> [281.240804] </TASK> <4> [281.240805] irq event stamp: 706557 <4> [281.240807] hardirqs last enabled at (706563): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.240810] hardirqs last disabled at (706568): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.240813] softirqs last enabled at (706396): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.240816] softirqs last disabled at (706389): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.240818] ---[ end trace 0000000000000000 ]--- <6> [281.240821] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.240896] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.240904] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.240925] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.241620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.241734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.241832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.241923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.242018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.242109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.242201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.242292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.242374] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.242470] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.242601] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.243809] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.253694] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.253962] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.255156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.255238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.255315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.255393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.255470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.255562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.255648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.255738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.255822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.255898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.255973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.256063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.256138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.256213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.256288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.256362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.256451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.256529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.256618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.256704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.256786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.256865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.256945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.257023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.257101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.257181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.257261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.257341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.257421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.257668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.257759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.257851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.257951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.258045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.258138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.258218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.258298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.258375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.258453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.258529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.258609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.258692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.258769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.258844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.258923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.259003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.259084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.259163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.259243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.259320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.259397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.259476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.259555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.259633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.259719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.259803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.259883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.259962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.260044] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.261426] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.261431] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20772, lrc_seqno=20772, guc_id=0, flags=0x73 in no process [-1] <7> [281.261434] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.261495] ------------[ cut here ]------------ <4> [281.261497] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.261498] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:11/210 <4> [281.261599] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.261666] autofs4 [last unloaded: snd_hda_intel] <4> [281.261671] CPU: 2 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.261674] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.261675] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.261676] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.261681] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.261771] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.261773] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.261776] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.261777] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.261778] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.261780] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.261781] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.261783] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.261785] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.261786] CR2: 00007b83c8850000 CR3: 000000012c600001 CR4: 0000000000f72ef0 <4> [281.261788] PKRU: 55555554 <4> [281.261790] Call Trace: <4> [281.261791] <TASK> <4> [281.261796] ? lock_sync+0x100/0x100 <4> [281.261801] ? lock_release+0xd0/0x2b0 <4> [281.261806] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.261812] process_one_work+0x239/0x760 <4> [281.261819] worker_thread+0x200/0x3f0 <4> [281.261822] ? __pfx_worker_thread+0x10/0x10 <4> [281.261825] kthread+0x10d/0x150 <4> [281.261829] ? __pfx_kthread+0x10/0x10 <4> [281.261833] ret_from_fork+0x3d4/0x480 <4> [281.261835] ? __pfx_kthread+0x10/0x10 <4> [281.261839] ret_from_fork_asm+0x1a/0x30 <4> [281.261847] </TASK> <4> [281.261848] irq event stamp: 717225 <4> [281.261850] hardirqs last enabled at (717231): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.261853] hardirqs last disabled at (717236): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.261856] softirqs last enabled at (713936): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.261859] softirqs last disabled at (713929): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.261861] ---[ end trace 0000000000000000 ]--- <6> [281.261863] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.261935] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [281.261947] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=52, flags=0x0 in xe_compute_pree [7500] <7> [281.261954] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [281.262204] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.262992] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.263101] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.263214] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.264075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.264219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.264368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.264508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.264645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.264796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.264892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.264987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.265082] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.265180] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.265312] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.266446] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.276699] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.276961] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.278195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.278273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.278351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.278435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.278523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.278612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.278706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.278794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.278885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.279085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.279173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.279262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.279351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.279437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.279526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.279616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.279700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.279774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.279862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.279944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.280027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.280111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.280192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.280268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.280345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.280422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.280500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.280578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.280667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.280774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.280854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.280935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.281041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.281129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.281290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.281374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.281456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.281536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.281616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.281702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.281784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.281868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.281951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.282029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.282111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.282190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.282269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.282349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.282426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.282502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.282579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.282659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.282746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.282829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.282909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.282983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.283054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.283124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.283196] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.284488] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.284493] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20772, lrc_seqno=20772, guc_id=0, flags=0x73 in no process [-1] <7> [281.284495] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.284556] ------------[ cut here ]------------ <4> [281.284557] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.284558] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3449 <4> [281.284630] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.284703] autofs4 [last unloaded: snd_hda_intel] <4> [281.284708] CPU: 2 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.284711] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.284713] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.284714] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.284720] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.284790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.284792] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.284795] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.284797] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.284799] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.284800] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.284801] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.284803] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.284805] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.284807] CR2: 00007b83c8850000 CR3: 000000012c600001 CR4: 0000000000f72ef0 <4> [281.284809] PKRU: 55555554 <4> [281.284810] Call Trace: <4> [281.284812] <TASK> <4> [281.284816] ? lock_sync+0x100/0x100 <4> [281.284821] ? lock_release+0xd0/0x2b0 <4> [281.284827] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.284832] process_one_work+0x239/0x760 <4> [281.284839] worker_thread+0x200/0x3f0 <4> [281.284842] ? __pfx_worker_thread+0x10/0x10 <4> [281.284845] kthread+0x10d/0x150 <4> [281.284848] ? __pfx_kthread+0x10/0x10 <4> [281.284852] ret_from_fork+0x3d4/0x480 <4> [281.284854] ? __pfx_kthread+0x10/0x10 <4> [281.284858] ret_from_fork_asm+0x1a/0x30 <4> [281.284866] </TASK> <4> [281.284868] irq event stamp: 655469 <4> [281.284869] hardirqs last enabled at (655475): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.284873] hardirqs last disabled at (655480): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.284875] softirqs last enabled at (652166): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.284878] softirqs last disabled at (652159): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.284881] ---[ end trace 0000000000000000 ]--- <7> [281.287304] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [281.287407] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20827, lrc_seqno=20827, guc_id=0, flags=0x73 in no process [-1] <7> [281.287413] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.287515] ------------[ cut here ]------------ <4> [281.287517] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [281.287451] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [281.287520] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:20/3453 <4> [281.287628] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.287719] autofs4 [last unloaded: snd_hda_intel] <4> [281.287724] CPU: 3 UID: 0 PID: 3453 Comm: kworker/u64:20 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.287727] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.287729] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.287731] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.287737] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.287814] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.287817] RSP: 0018:ffffc900025cfca0 EFLAGS: 00010246 <4> [281.287820] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.287822] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.287824] RBP: ffffc900025cfdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.287825] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.287827] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.287828] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000 <4> [281.287830] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.287832] CR2: 00005adf76340e50 CR3: 000000033b287003 CR4: 0000000000f72ef0 <4> [281.287834] PKRU: 55555554 <4> [281.287835] Call Trace: <4> [281.287837] <TASK> <4> [281.287841] ? lock_sync+0x100/0x100 <4> [281.287846] ? lock_release+0xd0/0x2b0 <4> [281.287853] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.287859] process_one_work+0x239/0x760 <4> [281.287866] worker_thread+0x200/0x3f0 <4> [281.287869] ? __pfx_worker_thread+0x10/0x10 <4> [281.287872] kthread+0x10d/0x150 <4> [281.287875] ? __pfx_kthread+0x10/0x10 <4> [281.287879] ret_from_fork+0x3d4/0x480 <4> [281.287882] ? __pfx_kthread+0x10/0x10 <4> [281.287886] ret_from_fork_asm+0x1a/0x30 <4> [281.287893] </TASK> <4> [281.287895] irq event stamp: 317127 <4> [281.287897] hardirqs last enabled at (317133): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.287901] hardirqs last disabled at (317138): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.287903] softirqs last enabled at (316796): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.287906] softirqs last disabled at (316787): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.287909] ---[ end trace 0000000000000000 ]--- <6> [281.287912] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.287985] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.287994] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.288068] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.288850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.288963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.289075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.289185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.289296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.289405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.289494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.289606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.289696] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.289806] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.289970] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.291259] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.301698] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.301990] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.304085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.304176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.304256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.304422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.304520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.304634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.305107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.305373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.305501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.305648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.305822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.305900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.306003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.306104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.306245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.306384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.306563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.306695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.307381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.307466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.307550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.307633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.307728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.307808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.307886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.307964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.308041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.308121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.308658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.308802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.308901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.309195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.309365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.309506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.309689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.309803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.309887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.309968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.310048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.310131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.310216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.310297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.310378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.310460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.310545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.310624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.310711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.310790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.310868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.310976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.311069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.311166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.311245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.311323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.311404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.311487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.311568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.311648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.311740] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.313421] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.313426] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20827, lrc_seqno=20827, guc_id=0, flags=0x73 in no process [-1] <7> [281.313429] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.313491] ------------[ cut here ]------------ <4> [281.313492] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.313494] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:16/3449 <4> [281.313566] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.313636] autofs4 [last unloaded: snd_hda_intel] <4> [281.313641] CPU: 2 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.313644] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.313645] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.313646] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.313652] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.313749] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.313752] RSP: 0000:ffffc900025afca0 EFLAGS: 00010246 <4> [281.313754] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.313756] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.313758] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.313759] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.313761] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.313762] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.313764] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.313766] CR2: 00007b83cae12000 CR3: 00000001228d9004 CR4: 0000000000f72ef0 <4> [281.313767] PKRU: 55555554 <4> [281.313769] Call Trace: <4> [281.313770] <TASK> <4> [281.313774] ? lock_sync+0x100/0x100 <4> [281.313779] ? lock_release+0xd0/0x2b0 <4> [281.313785] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.313791] process_one_work+0x239/0x760 <4> [281.313799] worker_thread+0x200/0x3f0 <4> [281.313802] ? __pfx_worker_thread+0x10/0x10 <4> [281.313805] kthread+0x10d/0x150 <4> [281.313808] ? __pfx_kthread+0x10/0x10 <4> [281.313812] ret_from_fork+0x3d4/0x480 <4> [281.313815] ? __pfx_kthread+0x10/0x10 <4> [281.313819] ret_from_fork_asm+0x1a/0x30 <4> [281.313827] </TASK> <4> [281.313829] irq event stamp: 668903 <4> [281.313831] hardirqs last enabled at (668909): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.313834] hardirqs last disabled at (668914): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.313837] softirqs last enabled at (668742): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.313840] softirqs last disabled at (668737): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.313843] ---[ end trace 0000000000000000 ]--- <6> [281.315020] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.315118] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.315127] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.315203] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.315308] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.315416] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.316115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.316227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.316324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.316413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.316512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.316611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.316713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.316814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.316906] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.317007] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.317158] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.318473] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.328697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.328989] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.330706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.330795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.330873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.331391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.331539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.331644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.331762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.331838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.331940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.332047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.332689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.332855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.333098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.333199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.333275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.333523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.333632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.333735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.333872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.333957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.334041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.334123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.334204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.334283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.334361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.334440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.334519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.334605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.334738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.335243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.335380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.335488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.335637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.335775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.335888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.335994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.336075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.336154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.336234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.336311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.336391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.336470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.336554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.336635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.336731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.336811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.336890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.337001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.337082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.337159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.337236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.337316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.337394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.337472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.337549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.337628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.337718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.337802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.337885] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.339258] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.339265] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20827, lrc_seqno=20827, guc_id=0, flags=0x73 in no process [-1] <7> [281.339269] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.339334] ------------[ cut here ]------------ <4> [281.339335] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.339337] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3449 <4> [281.339413] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.339483] autofs4 [last unloaded: snd_hda_intel] <4> [281.339487] CPU: 0 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.339490] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.339491] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.339493] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.339498] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.339572] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.339574] RSP: 0000:ffffc900025afca0 EFLAGS: 00010246 <4> [281.339576] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.339578] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.339580] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.339581] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.339583] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.339584] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [281.339586] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.339588] CR2: 00005adf76356040 CR3: 00000003714ed001 CR4: 0000000000f72ef0 <4> [281.339590] PKRU: 55555554 <4> [281.339591] Call Trace: <4> [281.339593] <TASK> <4> [281.339597] ? lock_sync+0x100/0x100 <4> [281.339602] ? lock_release+0xd0/0x2b0 <4> [281.339608] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.339614] process_one_work+0x239/0x760 <4> [281.339621] worker_thread+0x200/0x3f0 <4> [281.339624] ? __pfx_worker_thread+0x10/0x10 <4> [281.339627] kthread+0x10d/0x150 <4> [281.339630] ? __pfx_kthread+0x10/0x10 <4> [281.339634] ret_from_fork+0x3d4/0x480 <4> [281.339637] ? __pfx_kthread+0x10/0x10 <4> [281.339640] ret_from_fork_asm+0x1a/0x30 <4> [281.339648] </TASK> <4> [281.339649] irq event stamp: 679611 <4> [281.339651] hardirqs last enabled at (679617): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.339654] hardirqs last disabled at (679622): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.339657] softirqs last enabled at (677754): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.339660] softirqs last disabled at (677749): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.339662] ---[ end trace 0000000000000000 ]--- <7> [281.341266] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.341425] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [281.341810] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20882, lrc_seqno=20882, guc_id=0, flags=0x73 in no process [-1] <7> [281.341817] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.341936] ------------[ cut here ]------------ <4> [281.341938] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.341940] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:11/210 <4> [281.342061] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.342159] autofs4 [last unloaded: snd_hda_intel] <4> [281.342165] CPU: 14 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.342170] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.342172] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.342174] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.342182] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.342302] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.342304] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.342307] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.342309] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.342311] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.342313] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.342315] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.342317] FS: 0000000000000000(0000) GS:ffff8888db397000(0000) knlGS:0000000000000000 <4> [281.342320] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.342322] CR2: 00007b83c3cb0000 CR3: 000000011e4d6003 CR4: 0000000000f72ef0 <4> [281.342324] PKRU: 55555554 <4> [281.342325] Call Trace: <4> [281.342327] <TASK> <4> [281.342333] ? lock_sync+0x100/0x100 <4> [281.342341] ? lock_release+0xd0/0x2b0 <4> [281.342349] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.342359] process_one_work+0x239/0x760 <4> [281.342369] worker_thread+0x200/0x3f0 <4> [281.342374] ? __pfx_worker_thread+0x10/0x10 <4> [281.342377] kthread+0x10d/0x150 <4> [281.342381] ? __pfx_kthread+0x10/0x10 <4> [281.342387] ret_from_fork+0x3d4/0x480 <4> [281.342390] ? __pfx_kthread+0x10/0x10 <4> [281.342395] ret_from_fork_asm+0x1a/0x30 <4> [281.342407] </TASK> <4> [281.342409] irq event stamp: 725529 <4> [281.342411] hardirqs last enabled at (725535): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.342415] hardirqs last disabled at (725540): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.342418] softirqs last enabled at (722322): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.342422] softirqs last disabled at (722315): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.342425] ---[ end trace 0000000000000000 ]--- <6> [281.342438] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.342519] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.342528] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.342547] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.343445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.343541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.343639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.343768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.343906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.344036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.344149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.344246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.344332] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.344434] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.344568] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.345733] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.355749] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.356023] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.357116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.357204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.357286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.357373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.357469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.357551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.357635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.357871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.357948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.358024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.358102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.358191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.358282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.358372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.358462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.358549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.358625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.358715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.358802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.358886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.358968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.359047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.359127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.359206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.359287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.359367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.359445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.359524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.359604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.359689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.359779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.359865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.359975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.360071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.360170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.360257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.360341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.360420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.360500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.360577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.360657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.360744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.360822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.360900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.360985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.361066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.361149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.361230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.361311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.361390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.361468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.361548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.361626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.361710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.361788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.361867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.361943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.362019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.362098] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.363451] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.363456] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20882, lrc_seqno=20882, guc_id=0, flags=0x73 in no process [-1] <7> [281.363459] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.363518] ------------[ cut here ]------------ <4> [281.363519] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.363521] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:11/210 <4> [281.363615] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.363688] autofs4 [last unloaded: snd_hda_intel] <4> [281.363693] CPU: 10 UID: 0 PID: 210 Comm: kworker/u64:11 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.363696] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.363697] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.363698] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.363704] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.363775] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.363777] RSP: 0018:ffffc90001667ca0 EFLAGS: 00010246 <4> [281.363780] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.363782] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.363783] RBP: ffffc90001667db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.363784] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.363786] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.363788] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [281.363789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.363791] CR2: 00007b83cae12000 CR3: 0000000341421003 CR4: 0000000000f72ef0 <4> [281.363793] PKRU: 55555554 <4> [281.363794] Call Trace: <4> [281.363796] <TASK> <4> [281.363800] ? lock_sync+0x100/0x100 <4> [281.363805] ? lock_release+0xd0/0x2b0 <4> [281.363811] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.363817] process_one_work+0x239/0x760 <4> [281.363824] worker_thread+0x200/0x3f0 <4> [281.363827] ? __pfx_worker_thread+0x10/0x10 <4> [281.363830] kthread+0x10d/0x150 <4> [281.363833] ? __pfx_kthread+0x10/0x10 <4> [281.363837] ret_from_fork+0x3d4/0x480 <4> [281.363840] ? __pfx_kthread+0x10/0x10 <4> [281.363843] ret_from_fork_asm+0x1a/0x30 <4> [281.363851] </TASK> <4> [281.363853] irq event stamp: 736235 <4> [281.363854] hardirqs last enabled at (736241): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.363857] hardirqs last disabled at (736246): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.363860] softirqs last enabled at (734054): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.363863] softirqs last disabled at (734047): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.363865] ---[ end trace 0000000000000000 ]--- <6> [281.363868] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.363939] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [281.363949] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=32, flags=0x0 in xe_compute_pree [7500] <7> [281.363956] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [281.364179] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.364968] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.365074] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.365185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.366068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.366189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.366316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.366437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.366557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.366673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.366819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.366938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.367057] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.367181] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.367341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.368555] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.378693] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.378994] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.380225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.380311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.380390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.380478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.380648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.380791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.380870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.380949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.381027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.381106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.381194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.381272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.381351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.381430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.381509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.381588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.381666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.381789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.381868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.381955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.382039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.382121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.382203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.382284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.382362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.382441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.382520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.382602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.382691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.382778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.382856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.382933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.383012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.383091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.383168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.383243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.383318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.383389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.383464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.383539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.383616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.383696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.383780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.383857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.383937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.384007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.384078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.384148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.384221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.384295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.384369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.384445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.384518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.384590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.384661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.384754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.384830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.384902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.384978] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.386332] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.386337] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20882, lrc_seqno=20882, guc_id=0, flags=0x73 in no process [-1] <7> [281.386340] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.386400] ------------[ cut here ]------------ <4> [281.386401] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.386403] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:16/3449 <4> [281.386476] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.386544] autofs4 [last unloaded: snd_hda_intel] <4> [281.386548] CPU: 1 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.386551] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.386553] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.386554] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.386560] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.386630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.386632] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.386634] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.386636] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.386637] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.386638] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.386640] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.386641] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [281.386643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.386644] CR2: 00007b83c2448000 CR3: 000000012943d002 CR4: 0000000000f72ef0 <4> [281.386646] PKRU: 55555554 <4> [281.386647] Call Trace: <4> [281.386648] <TASK> <4> [281.386652] ? lock_sync+0x100/0x100 <4> [281.386657] ? lock_release+0xd0/0x2b0 <4> [281.386663] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.386668] process_one_work+0x239/0x760 <4> [281.386675] worker_thread+0x200/0x3f0 <4> [281.386678] ? __pfx_worker_thread+0x10/0x10 <4> [281.386680] kthread+0x10d/0x150 <4> [281.386691] ? __pfx_kthread+0x10/0x10 <4> [281.386697] ret_from_fork+0x3d4/0x480 <4> [281.386701] ? __pfx_kthread+0x10/0x10 <4> [281.386706] ret_from_fork_asm+0x1a/0x30 <4> [281.386714] </TASK> <4> [281.386715] irq event stamp: 692943 <4> [281.386716] hardirqs last enabled at (692949): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.386719] hardirqs last disabled at (692954): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.386722] softirqs last enabled at (692906): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.386724] softirqs last disabled at (692901): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.386727] ---[ end trace 0000000000000000 ]--- <6> [281.388509] xe 0000:03:00.0: [drm] exec queue reset detected <6> [281.388542] xe 0000:03:00.0: [drm] exec queue reset detected <5> [281.388702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20937, lrc_seqno=20937, guc_id=0, flags=0x73 in no process [-1] <7> [281.388708] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.388858] ------------[ cut here ]------------ <4> [281.388860] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.388862] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:15/3448 <4> [281.388984] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy <7> [281.388927] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [281.389002] drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [281.389093] CPU: 12 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.389098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.389100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.389102] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [281.389075] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [281.389111] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.389231] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.389233] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [281.389237] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.389239] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.389241] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.389243] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.389245] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.389247] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [281.389250] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.389252] CR2: 00005adf76340e50 CR3: 000000037141c002 CR4: 0000000000f72ef0 <4> [281.389254] PKRU: 55555554 <4> [281.389256] Call Trace: <4> [281.389257] <TASK> <4> [281.389264] ? lock_sync+0x100/0x100 <4> [281.389272] ? lock_release+0xd0/0x2b0 <4> [281.389280] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.389290] process_one_work+0x239/0x760 <4> [281.389301] worker_thread+0x200/0x3f0 <4> [281.389305] ? __pfx_worker_thread+0x10/0x10 <4> [281.389309] kthread+0x10d/0x150 <4> [281.389313] ? __pfx_kthread+0x10/0x10 <4> [281.389318] ret_from_fork+0x3d4/0x480 <4> [281.389321] ? __pfx_kthread+0x10/0x10 <4> [281.389326] ret_from_fork_asm+0x1a/0x30 <4> [281.389339] </TASK> <4> [281.389340] irq event stamp: 1465927 <4> [281.389342] hardirqs last enabled at (1465933): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.389347] hardirqs last disabled at (1465938): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.389350] softirqs last enabled at (1463116): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [281.389353] softirqs last disabled at (1463114): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [281.389357] ---[ end trace 0000000000000000 ]--- <6> [281.389359] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.389478] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.389488] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.389508] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.390266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.390365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.390463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.390553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.390641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.390744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.390832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.390919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.391003] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.391100] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.391245] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.392326] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.402697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.403007] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.404197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.404305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.404410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.404518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.404623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.404742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.404844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.404945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.405045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.405146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.405252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.405357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.405457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.405558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.405657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.405776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.405877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.405976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.406078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.406192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.406301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.406408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.406520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.406626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.406797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.406910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.407017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.407126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.407235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.407342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.407449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.407559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.407681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.407839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.407949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.408049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.408135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.408218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.408298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.408375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.408456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.408535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.408614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.408702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.408788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.408869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.408948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.409025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.409104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.409181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.409257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.409338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.409420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.409500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.409578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.409657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.409743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.409819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.409899] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.411470] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.411476] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20937, lrc_seqno=20937, guc_id=0, flags=0x73 in no process [-1] <7> [281.411479] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.411542] ------------[ cut here ]------------ <4> [281.411543] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.411545] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:16/3449 <4> [281.411620] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.411701] autofs4 [last unloaded: snd_hda_intel] <4> [281.411705] CPU: 8 UID: 0 PID: 3449 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.411708] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.411710] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.411711] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.411717] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.411790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.411792] RSP: 0018:ffffc900025afca0 EFLAGS: 00010246 <4> [281.411795] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.411796] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.411797] RBP: ffffc900025afdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.411798] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.411800] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.411801] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [281.411803] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.411804] CR2: 00007b83c8ab0000 CR3: 00000001240fe003 CR4: 0000000000f72ef0 <4> [281.411806] PKRU: 55555554 <4> [281.411807] Call Trace: <4> [281.411808] <TASK> <4> [281.411812] ? lock_sync+0x100/0x100 <4> [281.411817] ? lock_release+0xd0/0x2b0 <4> [281.411823] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.411829] process_one_work+0x239/0x760 <4> [281.411835] worker_thread+0x200/0x3f0 <4> [281.411838] ? __pfx_worker_thread+0x10/0x10 <4> [281.411841] kthread+0x10d/0x150 <4> [281.411844] ? __pfx_kthread+0x10/0x10 <4> [281.411848] ret_from_fork+0x3d4/0x480 <4> [281.411850] ? __pfx_kthread+0x10/0x10 <4> [281.411853] ret_from_fork_asm+0x1a/0x30 <4> [281.411861] </TASK> <4> [281.411863] irq event stamp: 705631 <4> [281.411864] hardirqs last enabled at (705637): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.411867] hardirqs last disabled at (705642): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.411869] softirqs last enabled at (703444): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.411872] softirqs last disabled at (703439): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.411874] ---[ end trace 0000000000000000 ]--- <6> [281.412759] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.412833] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [281.412842] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=24, flags=0x0 in xe_compute_pree [7500] <7> [281.412844] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [281.412950] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.412973] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.413079] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.413186] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.414078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.414177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.414273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.414364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.414482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.414574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.414665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.414746] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence) <7> [281.414738] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence) <7> [281.414766] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence) <7> [281.414772] xe 0000:03:00.0: [drm:xe_sync_entry_parse [xe]] Ioctl argument check failed at drivers/gpu/drm/xe/xe_sync.c:206: IS_ERR(sync->ufence) <7> [281.414785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.414905] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.415040] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.415198] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.420219] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.431741] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.433749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.437793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.437913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.438011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.438107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.438242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.438340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.438437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.438533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.438630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.438753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.438850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.438950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.439050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.439150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.439267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.439361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.439461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.439563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.439664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.439979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.440075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.440337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.440420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.440516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.440621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.441003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.441122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.441239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.441353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.441608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.441757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.441853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.441960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.442066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.442374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.442479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.442581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.442679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.443004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.443115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.443386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.443500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.443608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.443732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.443842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.443927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.444011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.444092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.444172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.444249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.444326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.444406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.444483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.444560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.444636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.445015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.445336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.445452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.445570] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.448564] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.448575] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20937, lrc_seqno=20937, guc_id=0, flags=0x73 in no process [-1] <7> [281.448579] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.448673] ------------[ cut here ]------------ <4> [281.448675] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.448677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:15/3448 <4> [281.448814] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.448932] autofs4 [last unloaded: snd_hda_intel] <4> [281.448939] CPU: 11 UID: 0 PID: 3448 Comm: kworker/u64:15 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.448943] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.448946] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.448948] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.448957] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.449054] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.449057] RSP: 0018:ffffc900025a7ca0 EFLAGS: 00010246 <4> [281.449060] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.449063] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.449064] RBP: ffffc900025a7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.449066] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.449067] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.449069] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [281.449072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.449074] CR2: 00007b83c9d14000 CR3: 000000012943d003 CR4: 0000000000f72ef0 <4> [281.449076] PKRU: 55555554 <4> [281.449078] Call Trace: <4> [281.449080] <TASK> <4> [281.449086] ? lock_sync+0x100/0x100 <4> [281.449094] ? lock_release+0xd0/0x2b0 <4> [281.449103] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.449111] process_one_work+0x239/0x760 <4> [281.449121] worker_thread+0x200/0x3f0 <4> [281.449125] ? __pfx_worker_thread+0x10/0x10 <4> [281.449129] kthread+0x10d/0x150 <4> [281.449133] ? __pfx_kthread+0x10/0x10 <4> [281.449137] ret_from_fork+0x3d4/0x480 <4> [281.449141] ? __pfx_kthread+0x10/0x10 <4> [281.449146] ret_from_fork_asm+0x1a/0x30 <4> [281.449158] </TASK> <4> [281.449159] irq event stamp: 1480431 <4> [281.449161] hardirqs last enabled at (1480437): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.449165] hardirqs last disabled at (1480442): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.449169] softirqs last enabled at (1477270): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.449172] softirqs last disabled at (1477237): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.449175] ---[ end trace 0000000000000000 ]--- <5> [281.450255] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=16, flags=0x0 in xe_compute_pree [7500] <7> [281.450260] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [281.450980] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.451203] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.451350] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.451487] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.451627] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.451827] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.451966] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [281.452369] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20992, lrc_seqno=20992, guc_id=0, flags=0x73 in no process [-1] <7> [281.452374] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.452447] ------------[ cut here ]------------ <4> [281.452450] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.452452] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208 <4> [281.452542] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.452616] autofs4 [last unloaded: snd_hda_intel] <4> [281.452621] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.452625] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.452627] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.452630] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.452639] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.453334] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.453336] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246 <4> [281.453339] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.453341] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.453342] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.453343] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.453345] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.453346] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000 <4> [281.453348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.453349] CR2: 00007b83bc2e8000 CR3: 000000012943d006 CR4: 0000000000f72ef0 <4> [281.453350] PKRU: 55555554 <4> [281.453352] Call Trace: <4> [281.453353] <TASK> <4> [281.453357] ? lock_sync+0x100/0x100 <4> [281.453363] ? lock_release+0xd0/0x2b0 <4> [281.453368] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.453374] process_one_work+0x239/0x760 <4> [281.453381] worker_thread+0x200/0x3f0 <4> [281.453384] ? __pfx_worker_thread+0x10/0x10 <4> [281.453386] kthread+0x10d/0x150 <4> [281.453722] ? __pfx_kthread+0x10/0x10 <4> [281.453728] ret_from_fork+0x3d4/0x480 <4> [281.453731] ? __pfx_kthread+0x10/0x10 <4> [281.453736] ret_from_fork_asm+0x1a/0x30 <4> [281.453746] </TASK> <4> [281.453747] irq event stamp: 759567 <4> [281.453749] hardirqs last enabled at (759573): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.453753] hardirqs last disabled at (759578): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.453757] softirqs last enabled at (759532): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.453761] softirqs last disabled at (759205): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.453765] ---[ end trace 0000000000000000 ]--- <6> [281.458698] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.458805] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.458820] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.459364] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.460183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <6> [281.460293] [IGT] xe_compute_preempt: finished subtest engine-DRM_XE_ENGINE_CLASS_COMPUTE, FAIL <7> [281.460284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.460384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.460477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.460565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.460651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.460772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.460880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <6> [281.460936] [IGT] xe_compute_preempt: finished subtest compute-preempt-many-vram-evict, FAIL <7> [281.460990] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.461105] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.461249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.462332] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.472714] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.473167] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.474976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.475090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.475169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.475245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.475320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.475393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.475466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.475537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.475611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.475695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.475769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.475843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.475918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.475993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.476069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.476143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.476218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.476292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.476366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.476450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.476534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.476616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.476715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.476794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.476873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.476951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.477028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.477112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.477195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.477275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.477353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.477433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.477517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.477600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.477688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.477770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.477850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.477928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.478005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.478081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.478159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.478239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.478320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.478398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.478480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.478558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.478636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.478724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.478803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.478883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.478965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.479048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.479128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.479208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.479285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.479364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.479441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.479517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.479598] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.480564] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.480781] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20992, lrc_seqno=20992, guc_id=0, flags=0x73 in no process [-1] <7> [281.480789] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.480894] ------------[ cut here ]------------ <4> [281.480896] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.480898] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:17/3450 <4> [281.481113] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.481206] autofs4 [last unloaded: snd_hda_intel] <4> [281.481212] CPU: 10 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.481216] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.481217] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.481263] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.481271] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.481515] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.481519] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [281.481523] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.481525] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.481527] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.481529] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.481530] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.481532] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [281.481533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.481535] CR2: 00005adf76340e50 CR3: 000000037bbf4004 CR4: 0000000000f72ef0 <4> [281.481536] PKRU: 55555554 <4> [281.481538] Call Trace: <4> [281.481539] <TASK> <4> [281.481544] ? lock_sync+0x100/0x100 <4> [281.481550] ? lock_release+0xd0/0x2b0 <4> [281.481557] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.481564] process_one_work+0x239/0x760 <4> [281.481572] worker_thread+0x200/0x3f0 <4> [281.481575] ? __pfx_worker_thread+0x10/0x10 <4> [281.481577] kthread+0x10d/0x150 <4> [281.481581] ? __pfx_kthread+0x10/0x10 <4> [281.481585] ret_from_fork+0x3d4/0x480 <4> [281.481588] ? __pfx_kthread+0x10/0x10 <4> [281.481592] ret_from_fork_asm+0x1a/0x30 <4> [281.481600] </TASK> <4> [281.481601] irq event stamp: 489631 <4> [281.481603] hardirqs last enabled at (489637): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.481607] hardirqs last disabled at (489642): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.481609] softirqs last enabled at (488828): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.481612] softirqs last disabled at (488819): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.481614] ---[ end trace 0000000000000000 ]--- <6> [281.481617] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.481740] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.481765] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.482697] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.482821] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.483030] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.483509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.483604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.483735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.483827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.483914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.484015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.484105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.484197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.484313] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.484416] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.484532] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.485907] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.495696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.496030] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.497373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.497463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.497546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.497627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.497866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.497944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.498023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.498102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.498181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.498258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.498334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.498418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.498496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.498570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.498644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.499050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.499126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.499201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.499276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.499359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.499442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.499525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.499606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.499689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.499767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.499844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.499921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.500000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.500083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.500169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.500249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.500327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.500423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.500512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.500599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.500688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.500771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.500852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.500930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.501009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.501101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.501192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.501278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.501356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.501438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.501516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.501599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.501680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.501810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.501900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.501981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.502064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.502144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.502223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.502301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.502382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.502464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.502544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.502627] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.503416] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.503421] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20992, lrc_seqno=20992, guc_id=0, flags=0x73 in no process [-1] <7> [281.503424] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.503486] ------------[ cut here ]------------ <4> [281.503488] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.503490] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:17/3450 <4> [281.503563] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.503648] autofs4 [last unloaded: snd_hda_intel] <4> [281.503653] CPU: 8 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.503656] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.503658] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.503659] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.503666] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.503752] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.503754] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [281.503756] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.503758] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.503759] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.503761] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.503762] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.503764] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [281.503765] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.503767] CR2: 00007b83c8ab3818 CR3: 000000037bbf4005 CR4: 0000000000f72ef0 <4> [281.503768] PKRU: 55555554 <4> [281.503770] Call Trace: <4> [281.503771] <TASK> <4> [281.503775] ? lock_sync+0x100/0x100 <4> [281.503780] ? lock_release+0xd0/0x2b0 <4> [281.503786] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.503792] process_one_work+0x239/0x760 <4> [281.503799] worker_thread+0x200/0x3f0 <4> [281.503802] ? __pfx_worker_thread+0x10/0x10 <4> [281.503805] kthread+0x10d/0x150 <4> [281.503808] ? __pfx_kthread+0x10/0x10 <4> [281.503812] ret_from_fork+0x3d4/0x480 <4> [281.503814] ? __pfx_kthread+0x10/0x10 <4> [281.503818] ret_from_fork_asm+0x1a/0x30 <4> [281.503826] </TASK> <4> [281.503827] irq event stamp: 497847 <4> [281.503828] hardirqs last enabled at (497853): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.503832] hardirqs last disabled at (497858): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.503835] softirqs last enabled at (495890): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.503837] softirqs last disabled at (495885): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.503840] ---[ end trace 0000000000000000 ]--- <7> [281.504955] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.505098] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.505477] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.505566] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.505653] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <5> [281.505841] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21047, lrc_seqno=21047, guc_id=0, flags=0x73 in no process [-1] <7> [281.505799] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.505848] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [281.505891] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <4> [281.505957] ------------[ cut here ]------------ <4> [281.505958] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.505960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:24/5328 <4> [281.506080] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.506189] autofs4 [last unloaded: snd_hda_intel] <4> [281.506196] CPU: 14 UID: 0 PID: 5328 Comm: kworker/u64:24 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.506201] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.506203] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.506205] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.506215] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.506344] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.506347] RSP: 0018:ffffc9000437bca0 EFLAGS: 00010246 <4> [281.506350] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.506353] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.506355] RBP: ffffc9000437bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.506357] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.506359] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.506361] FS: 0000000000000000(0000) GS:ffff8888db397000(0000) knlGS:0000000000000000 <4> [281.506364] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.506366] CR2: 00007b83c3cb0000 CR3: 000000012943d004 CR4: 0000000000f72ef0 <4> [281.506369] PKRU: 55555554 <4> [281.506371] Call Trace: <4> [281.506373] <TASK> <4> [281.506380] ? lock_sync+0x100/0x100 <4> [281.506388] ? lock_release+0xd0/0x2b0 <4> [281.506397] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.506407] process_one_work+0x239/0x760 <4> [281.506419] worker_thread+0x200/0x3f0 <4> [281.506423] ? __pfx_worker_thread+0x10/0x10 <4> [281.506427] kthread+0x10d/0x150 <4> [281.506431] ? __pfx_kthread+0x10/0x10 <4> [281.506437] ret_from_fork+0x3d4/0x480 <4> [281.506441] ? __pfx_kthread+0x10/0x10 <4> [281.506446] ret_from_fork_asm+0x1a/0x30 <4> [281.506459] </TASK> <4> [281.506461] irq event stamp: 90133 <4> [281.506463] hardirqs last enabled at (90139): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.506468] hardirqs last disabled at (90144): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.506471] softirqs last enabled at (89340): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.506475] softirqs last disabled at (89335): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.506478] ---[ end trace 0000000000000000 ]--- <6> [281.506481] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.506596] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.506605] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.507178] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.507600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.507706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.507804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.507897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.507991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.508083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.508176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.508273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.508364] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.508465] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.508586] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.509718] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.519691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.519952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.521126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.521210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.521289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.521367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.521447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.521525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.521601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.521677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.521771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.521848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.521925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.522001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.522077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.522151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.522227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.522304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.522382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.522459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.522534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.522627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.522758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.522853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.522937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.523018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.523100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.523179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.523257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.523337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.523418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.523496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.523575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.523655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.523749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.523834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.523920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.524003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.524084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.524162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.524241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.524322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.524407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.524488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.524566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.524647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.524741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.524836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.524918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.524998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.525077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.525153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.525230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.525311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.525389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.525468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.525545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.525624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.525707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.525783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.525867] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.526600] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.526605] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21047, lrc_seqno=21047, guc_id=0, flags=0x73 in no process [-1] <7> [281.526608] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.526672] ------------[ cut here ]------------ <4> [281.526673] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.526675] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:24/5328 <4> [281.526765] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.526843] autofs4 [last unloaded: snd_hda_intel] <4> [281.526848] CPU: 8 UID: 0 PID: 5328 Comm: kworker/u64:24 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.526851] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.526852] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.526854] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.526860] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.526931] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.526933] RSP: 0018:ffffc9000437bca0 EFLAGS: 00010246 <4> [281.526936] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.526938] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.526939] RBP: ffffc9000437bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.526941] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.526942] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.526943] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [281.526945] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.526947] CR2: 00007b83c8ab3818 CR3: 000000037bbf4005 CR4: 0000000000f72ef0 <4> [281.526949] PKRU: 55555554 <4> [281.526950] Call Trace: <4> [281.526951] <TASK> <4> [281.526956] ? lock_sync+0x100/0x100 <4> [281.526961] ? lock_release+0xd0/0x2b0 <4> [281.526967] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.526972] process_one_work+0x239/0x760 <4> [281.526980] worker_thread+0x200/0x3f0 <4> [281.526983] ? __pfx_worker_thread+0x10/0x10 <4> [281.526985] kthread+0x10d/0x150 <4> [281.526989] ? __pfx_kthread+0x10/0x10 <4> [281.526993] ret_from_fork+0x3d4/0x480 <4> [281.526995] ? __pfx_kthread+0x10/0x10 <4> [281.526999] ret_from_fork_asm+0x1a/0x30 <4> [281.527007] </TASK> <4> [281.527008] irq event stamp: 98763 <4> [281.527010] hardirqs last enabled at (98769): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.527013] hardirqs last disabled at (98774): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.527016] softirqs last enabled at (96428): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.527019] softirqs last disabled at (96419): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.527021] ---[ end trace 0000000000000000 ]--- <6> [281.527023] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.527094] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.527101] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.527509] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.527906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.527996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.528088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.528178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.528268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.528354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.528440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.528527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.528608] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.528771] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.528892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.529904] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.539691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.539967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.541036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.541120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.541198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.541276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.541354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.541431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.541506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.541582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.541658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.541744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.541820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.541895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.541971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.542046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.542122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.542197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.542272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.542348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.542427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.542513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.542597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.542678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.542776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.542857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.542938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.543019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.543101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.543184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.543266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.543346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.543426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.543506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.543592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.543676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.543775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.543858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.543943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.544026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.544107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.544185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.544266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.544345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.544424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.544503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.544584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.544663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.544752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.544830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.544909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.544989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.545070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.545152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.545231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.545311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.545387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.545466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.545542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.545619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.545703] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.546372] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.546376] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21047, lrc_seqno=21047, guc_id=0, flags=0x73 in no process [-1] <7> [281.546378] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.546441] ------------[ cut here ]------------ <4> [281.546442] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.546444] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:24/5328 <4> [281.546517] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.546583] autofs4 [last unloaded: snd_hda_intel] <4> [281.546587] CPU: 8 UID: 0 PID: 5328 Comm: kworker/u64:24 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.546590] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.546591] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.546592] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.546598] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.546668] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.546669] RSP: 0018:ffffc9000437bca0 EFLAGS: 00010246 <4> [281.546671] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.546673] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.546674] RBP: ffffc9000437bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.546675] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.546677] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.546678] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [281.546680] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.546687] CR2: 00007b83c8ab3818 CR3: 000000012943d004 CR4: 0000000000f72ef0 <4> [281.546688] PKRU: 55555554 <4> [281.546690] Call Trace: <4> [281.546691] <TASK> <4> [281.546695] ? lock_sync+0x100/0x100 <4> [281.546700] ? lock_release+0xd0/0x2b0 <4> [281.546705] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.546711] process_one_work+0x239/0x760 <4> [281.546718] worker_thread+0x200/0x3f0 <4> [281.546721] ? __pfx_worker_thread+0x10/0x10 <4> [281.546723] kthread+0x10d/0x150 <4> [281.546727] ? __pfx_kthread+0x10/0x10 <4> [281.546731] ret_from_fork+0x3d4/0x480 <4> [281.546733] ? __pfx_kthread+0x10/0x10 <4> [281.546736] ret_from_fork_asm+0x1a/0x30 <4> [281.546744] </TASK> <4> [281.546746] irq event stamp: 105761 <4> [281.546747] hardirqs last enabled at (105767): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.546750] hardirqs last disabled at (105772): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.546753] softirqs last enabled at (103536): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.546756] softirqs last disabled at (103531): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.546758] ---[ end trace 0000000000000000 ]--- <7> [281.548275] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.548320] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.548432] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.548460] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <5> [281.548567] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21102, lrc_seqno=21102, guc_id=0, flags=0x73 in no process [-1] <7> [281.548578] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.548637] ------------[ cut here ]------------ <4> [281.548639] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.548640] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:17/3450 <4> [281.548749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.548825] autofs4 [last unloaded: snd_hda_intel] <4> [281.548829] CPU: 9 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.548832] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.548834] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.548835] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.548841] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.548912] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.548914] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [281.548917] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.548918] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.548920] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.548921] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.548922] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.548924] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [281.548926] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.548927] CR2: 00007b83c8ab0000 CR3: 000000037bbf4002 CR4: 0000000000f72ef0 <4> [281.548929] PKRU: 55555554 <4> [281.548930] Call Trace: <4> [281.548931] <TASK> <4> [281.548935] ? lock_sync+0x100/0x100 <4> [281.548940] ? lock_release+0xd0/0x2b0 <4> [281.548946] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.548952] process_one_work+0x239/0x760 <4> [281.548958] worker_thread+0x200/0x3f0 <4> [281.548961] ? __pfx_worker_thread+0x10/0x10 <4> [281.548963] kthread+0x10d/0x150 <4> [281.548966] ? __pfx_kthread+0x10/0x10 <4> [281.548970] ret_from_fork+0x3d4/0x480 <4> [281.548972] ? __pfx_kthread+0x10/0x10 <4> [281.548975] ret_from_fork_asm+0x1a/0x30 <4> [281.548983] </TASK> <4> [281.548984] irq event stamp: 504353 <4> [281.548985] hardirqs last enabled at (504359): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.548988] hardirqs last disabled at (504364): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.548990] softirqs last enabled at (503610): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.548993] softirqs last disabled at (503585): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.548995] ---[ end trace 0000000000000000 ]--- <6> [281.548997] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.549068] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.549075] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.549481] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.549870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.549960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.550054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.550142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.550230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.550315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.550406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.550499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.550585] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.550690] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.550808] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.551840] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.561691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.561941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.562975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.563058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.563136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.563214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.563291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.563370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.563448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.563525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.563600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.563674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.563766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.563855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.563935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.564012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.564088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.564164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.564239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.564313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.564387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.564469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.564550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.564629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.564721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.564809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.564887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.564966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.565044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.565130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.565213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.565294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.565374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.565454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.565538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.565622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.565751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.565833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.565912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.565989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.566067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.566144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.566223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.566301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.566378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.566457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.566543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.566622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.566710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.566799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.566878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.566955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.567030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.567111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.567192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.567271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.567349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.567428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.567504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.567580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.567660] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.568354] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.568358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21102, lrc_seqno=21102, guc_id=0, flags=0x73 in no process [-1] <7> [281.568361] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.568420] ------------[ cut here ]------------ <4> [281.568421] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.568423] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:17/3450 <4> [281.568494] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.568558] autofs4 [last unloaded: snd_hda_intel] <4> [281.568562] CPU: 9 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.568565] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.568566] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.568568] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.568573] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.568643] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.568645] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [281.568647] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.568648] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.568649] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.568651] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.568652] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.568653] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [281.568655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.568656] CR2: 00007b83c8ab0000 CR3: 000000037bbf4002 CR4: 0000000000f72ef0 <4> [281.568658] PKRU: 55555554 <4> [281.568659] Call Trace: <4> [281.568660] <TASK> <4> [281.568664] ? lock_sync+0x100/0x100 <4> [281.568669] ? lock_release+0xd0/0x2b0 <4> [281.568674] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.568680] process_one_work+0x239/0x760 <4> [281.568696] worker_thread+0x200/0x3f0 <4> [281.568701] ? __pfx_worker_thread+0x10/0x10 <4> [281.568706] kthread+0x10d/0x150 <4> [281.568711] ? __pfx_kthread+0x10/0x10 <4> [281.568717] ret_from_fork+0x3d4/0x480 <4> [281.568720] ? __pfx_kthread+0x10/0x10 <4> [281.568726] ret_from_fork_asm+0x1a/0x30 <4> [281.568740] </TASK> <4> [281.568742] irq event stamp: 511193 <4> [281.568745] hardirqs last enabled at (511199): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.568749] hardirqs last disabled at (511204): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.568753] softirqs last enabled at (509150): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.568757] softirqs last disabled at (509143): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.568761] ---[ end trace 0000000000000000 ]--- <6> [281.569929] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.570006] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.570013] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.570069] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.570174] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.570283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.570671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.570780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.570882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.570971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.571058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.571145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.571232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.571320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.571404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.571497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.571615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.572629] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.582691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.582941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.583942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.584022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.584100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.584179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.584255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.584331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.584406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.584484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.584562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.584640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.584727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.584814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.584888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.584962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.585037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.585110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.585185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.585258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.585332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.585413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.585495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.585575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.585656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.585750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.585844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.585925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.586003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.586084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.586164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.586242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.586321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.586399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.586483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.586566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.586650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.586746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.586839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.586921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.587001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.587079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.587158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.587237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.587315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.587390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.587471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.587548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.587625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.587708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.587797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.587872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.587948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.588028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.588106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.588184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.588265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.588349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.588429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.588509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.588590] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.589259] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.589264] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21102, lrc_seqno=21102, guc_id=0, flags=0x73 in no process [-1] <7> [281.589266] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.589327] ------------[ cut here ]------------ <4> [281.589328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.589329] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:17/3450 <4> [281.589403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.589473] autofs4 [last unloaded: snd_hda_intel] <4> [281.589477] CPU: 9 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.589480] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.589482] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.589484] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.589489] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.589561] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.589563] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [281.589565] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.589567] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.589568] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.589569] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.589570] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.589572] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [281.589573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.589575] CR2: 00007b83c8ab0000 CR3: 000000037bbf4002 CR4: 0000000000f72ef0 <4> [281.589576] PKRU: 55555554 <4> [281.589577] Call Trace: <4> [281.589578] <TASK> <4> [281.589582] ? lock_sync+0x100/0x100 <4> [281.589587] ? lock_release+0xd0/0x2b0 <4> [281.589593] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.589598] process_one_work+0x239/0x760 <4> [281.589605] worker_thread+0x200/0x3f0 <4> [281.589608] ? __pfx_worker_thread+0x10/0x10 <4> [281.589610] kthread+0x10d/0x150 <4> [281.589613] ? __pfx_kthread+0x10/0x10 <4> [281.589617] ret_from_fork+0x3d4/0x480 <4> [281.589619] ? __pfx_kthread+0x10/0x10 <4> [281.589622] ret_from_fork_asm+0x1a/0x30 <4> [281.589630] </TASK> <4> [281.589631] irq event stamp: 517931 <4> [281.589632] hardirqs last enabled at (517937): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.589635] hardirqs last disabled at (517942): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.589637] softirqs last enabled at (515808): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.589640] softirqs last disabled at (515801): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.589642] ---[ end trace 0000000000000000 ]--- <5> [281.590319] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21157, lrc_seqno=21157, guc_id=0, flags=0x73 in no process [-1] <7> [281.590297] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.590324] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.590431] ------------[ cut here ]------------ <4> [281.590433] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.590436] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:24/5328 <4> [281.590515] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.590590] autofs4 [last unloaded: snd_hda_intel] <4> [281.590597] CPU: 5 UID: 0 PID: 5328 Comm: kworker/u64:24 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.590601] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.590602] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.590604] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.590612] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.590700] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.590703] RSP: 0018:ffffc9000437bca0 EFLAGS: 00010246 <4> [281.590707] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.590710] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.590712] RBP: ffffc9000437bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.590714] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.590717] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.590719] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [281.590722] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.590724] CR2: 00005adf763421c8 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [281.590727] PKRU: 55555554 <4> [281.590728] Call Trace: <4> [281.590730] <TASK> <4> [281.590736] ? lock_sync+0x100/0x100 <4> [281.590745] ? lock_release+0xd0/0x2b0 <4> [281.590753] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.590762] process_one_work+0x239/0x760 <4> [281.590772] worker_thread+0x200/0x3f0 <4> [281.590776] ? __pfx_worker_thread+0x10/0x10 <4> [281.590780] kthread+0x10d/0x150 <4> [281.590784] ? __pfx_kthread+0x10/0x10 <4> [281.590789] ret_from_fork+0x3d4/0x480 <4> [281.590793] ? __pfx_kthread+0x10/0x10 <4> [281.590797] ret_from_fork_asm+0x1a/0x30 <4> [281.590807] </TASK> <4> [281.590811] irq event stamp: 109751 <4> [281.590813] hardirqs last enabled at (109757): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.590818] hardirqs last disabled at (109762): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.590821] softirqs last enabled at (107504): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.590825] softirqs last disabled at (107497): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.590828] ---[ end trace 0000000000000000 ]--- <7> [281.590825] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <6> [281.590832] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.590978] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [281.590943] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <6> [281.590994] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.591031] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.591117] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.591223] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.591328] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.591435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.591831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.591922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.592016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.592105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.592192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.592277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.592364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.592451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.592534] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.592631] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.592762] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.593789] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.603691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.603951] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.604971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.605050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.605127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.605204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.605282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.605358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.605433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.605509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.605587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.605666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.605755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.605831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.605905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.605979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.606053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.606128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.606202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.606277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.606349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.606433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.606515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.606593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.606672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.606765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.606842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.606919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.606994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.607073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.607151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.607230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.607308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.607387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.607471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.607555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.607641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.607735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.607818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.607895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.607973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.608050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.608129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.608207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.608285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.608362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.608442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.608519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.608596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.608670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.608775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.608858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.608940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.609023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.609104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.609183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.609260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.609338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.609417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.609498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.609579] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.610258] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.610263] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21157, lrc_seqno=21157, guc_id=0, flags=0x73 in no process [-1] <7> [281.610265] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.610324] ------------[ cut here ]------------ <4> [281.610326] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.610327] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:24/5328 <4> [281.610399] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.610465] autofs4 [last unloaded: snd_hda_intel] <4> [281.610469] CPU: 5 UID: 0 PID: 5328 Comm: kworker/u64:24 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.610472] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.610473] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.610475] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.610480] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.610550] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.610552] RSP: 0018:ffffc9000437bca0 EFLAGS: 00010246 <4> [281.610554] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.610555] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.610557] RBP: ffffc9000437bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.610558] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.610559] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.610560] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [281.610562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.610563] CR2: 00005adf763421c8 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [281.610565] PKRU: 55555554 <4> [281.610566] Call Trace: <4> [281.610567] <TASK> <4> [281.610571] ? lock_sync+0x100/0x100 <4> [281.610576] ? lock_release+0xd0/0x2b0 <4> [281.610582] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.610587] process_one_work+0x239/0x760 <4> [281.610594] worker_thread+0x200/0x3f0 <4> [281.610597] ? __pfx_worker_thread+0x10/0x10 <4> [281.610599] kthread+0x10d/0x150 <4> [281.610602] ? __pfx_kthread+0x10/0x10 <4> [281.610606] ret_from_fork+0x3d4/0x480 <4> [281.610608] ? __pfx_kthread+0x10/0x10 <4> [281.610611] ret_from_fork_asm+0x1a/0x30 <4> [281.610618] </TASK> <4> [281.610620] irq event stamp: 116527 <4> [281.610621] hardirqs last enabled at (116533): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.610624] hardirqs last disabled at (116538): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.610626] softirqs last enabled at (114498): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.610628] softirqs last disabled at (114457): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.610630] ---[ end trace 0000000000000000 ]--- <6> [281.610632] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [281.610713] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [281.610719] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [281.611967] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.612073] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.612180] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [281.612565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [281.612657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [281.612771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [281.612863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [281.612952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [281.613039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [281.613129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [281.613220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [281.613303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [281.613400] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [281.613518] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [281.614574] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [281.624696] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [281.624947] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [281.625952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [281.626034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [281.626112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [281.626190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [281.626266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [281.626341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [281.626418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [281.626493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [281.626567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [281.626641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [281.626726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [281.626799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [281.626874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [281.626949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [281.627026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [281.627105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [281.627183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [281.627260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [281.627336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [281.627419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [281.627504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [281.627584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [281.627665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [281.627754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [281.627831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [281.627908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [281.627983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [281.628063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [281.628142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [281.628222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [281.628304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [281.628385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [281.628471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [281.628555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [281.628642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [281.628731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [281.628812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [281.628889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [281.628966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [281.629043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [281.629123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [281.629201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [281.629277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [281.629353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [281.629434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [281.629511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [281.629588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [281.629664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [281.629755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [281.629833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [281.629912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [281.629994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [281.630075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [281.630154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [281.630230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [281.630309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [281.630385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [281.630463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [281.630546] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [281.631193] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [281.631197] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=21157, lrc_seqno=21157, guc_id=0, flags=0x73 in no process [-1] <7> [281.631200] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [281.631260] ------------[ cut here ]------------ <4> [281.631261] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [281.631263] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:17/3450 <4> [281.631335] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink <4> [281.631414] autofs4 [last unloaded: snd_hda_intel] <4> [281.631419] CPU: 9 UID: 0 PID: 3450 Comm: kworker/u64:17 Tainted: G S U W 7.0.0-lgci-xe-xe-4919-3b9ca4c40814c96c3-debug+ #1 PREEMPT(lazy) <4> [281.631422] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [281.631423] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [281.631425] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [281.631431] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [281.631501] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [281.631502] RSP: 0018:ffffc900025b7ca0 EFLAGS: 00010246 <4> [281.631505] RAX: ffffffffa12046cb RBX: 0000000000000000 RCX: 0000000000000000 <4> [281.631506] RDX: ffff888101c1f610 RSI: ffffffffa12046cb RDI: ffffffffa1003ef0 <4> [281.631507] RBP: ffffc900025b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [281.631509] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [281.631510] R13: ffff888101c1f610 R14: ffff888113f8a018 R15: 00000000ffffffc2 <4> [281.631511] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000 <4> [281.631513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [281.631514] CR2: 00007b83c8ab0000 CR3: 000000037bbf4002 CR4: 0000000000f72ef0 <4> [281.631516] PKRU: 55555554 <4> [281.631517] Call Trace: <4> [281.631518] <TASK> <4> [281.631522] ? lock_sync+0x100/0x100 <4> [281.631527] ? lock_release+0xd0/0x2b0 <4> [281.631533] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [281.631539] process_one_work+0x239/0x760 <4> [281.631545] worker_thread+0x200/0x3f0 <4> [281.631548] ? __pfx_worker_thread+0x10/0x10 <4> [281.631551] kthread+0x10d/0x150 <4> [281.631554] ? __pfx_kthread+0x10/0x10 <4> [281.631557] ret_from_fork+0x3d4/0x480 <4> [281.631560] ? __pfx_kthread+0x10/0x10 <4> [281.631563] ret_from_fork_asm+0x1a/0x30 <4> [281.631570] </TASK> <4> [281.631571] irq event stamp: 528051 <4> [281.631573] hardirqs last enabled at (528057): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [281.631576] hardirqs last disabled at (528062): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [281.631578] softirqs last enabled at (526226): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.631581] softirqs last disabled at (526219): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [281.631583] ---[ end trace 0000000000000000 ]--- <7> [281.632823] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.632966] xe 0000:03:00.0: [drm:user_fence_worker [xe]] mmget_not_zero() failed, ufence wasn't signaled <7> [281.633061] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [281.633166] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [281.729003] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0 <6> [281.729405] [IGT] xe_compute_preempt: exiting, ret=98 <6> [281.745955] Console: switching to colour frame buffer device 240x67

<4> [280.018303] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.018605] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.061110] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.061468] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.085583] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.085851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.089796] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.090139] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.112183] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.112342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.139969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.140131] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.142815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.143084] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.164777] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.164947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.188707] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.188876] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.190463] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.190729] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.213777] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.213940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.238979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.239145] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.243027] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.243274] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.267378] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.267537] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.289301] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.289457] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.292664] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.292999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.316372] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.316527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.336964] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.337114] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.340196] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.340400] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.364087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.364245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.385960] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.386115] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.389971] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.390216] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.412016] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.412171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.433928] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.434097] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.436640] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.436906] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.461902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.462058] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.482232] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.482384] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.490746] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.490986] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.512249] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.512406] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.536850] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.537001] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.541323] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.541704] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.564042] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.564196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.585956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.586108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.590143] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.590393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.611753] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.611919] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.633954] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.634107] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.636884] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.637145] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.658341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.658496] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.678993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.679146] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.682045] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.682212] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.706010] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.706166] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.729869] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.730007] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.732038] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi

<4> [280.732197] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.754007] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.754162] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.778413] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.778553] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.780180] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.780463] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.805600] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.805777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.826787] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.826947] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.830052] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.830210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.852888] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.853040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.877049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.877201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.878823] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.879056] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.904485] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.904640] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.927767] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.927945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.930347] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.930504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.953122] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.953276] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.977586] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.977742] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [280.980933] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [280.981167] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.007931] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.008087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.035534] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.035712] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.038709] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.038879] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.060192] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.060347] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.083694] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.083885] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.086349] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.086554] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.110094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.110249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.132607] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.132792] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.134107] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec

<4> [281.134124] rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [281.134320] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.159020] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.159174] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.184815] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.184985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.187634] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.187813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.211379] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.211532] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.237886] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.238040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.240446] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate

<4> [281.240519] snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [281.240707] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.261599] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.261771] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.284630] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.284790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.287628] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.287814] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.313566] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.313749] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.339413] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.339572] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.342061] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.342302] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.363615] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.363775] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.386476] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.386630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.389002] drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [281.389231] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.411620] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.411790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.448814] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.449054] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.452542] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.453334] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.481113] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.481515] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.503563] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.503752] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.506080] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.506344] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.526765] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.526931] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.546517] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.546668] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.548749] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.548912] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.568494] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.568643] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.589403] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.589561] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.590515] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.590700] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.610399] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.610550] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [281.631335] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp cmdlinepart spi_nor hid_generic coretemp eeepc_wmi mtd asus_wmi sparse_keymap platform_profile mei_pxp mei_hdcp wmi_bmof binfmt_misc kvm_intel kvm irqbypass ghash_clmulni_intel r8169 aesni_intel usbhid snd_intel_dspcfg rapl snd_hda_codec hid intel_cstate snd_hda_core realtek snd_hwdep snd_pcm i2c_i801 video snd_timer i2c_mux snd spi_intel_pci soundcore spi_intel i2c_smbus idma64 intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery mei_me pmt_class intel_pmc_ssram_telemetry mei wmi acpi_pad pinctrl_alderlake acpi_tad intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink

<4> [281.631501] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 c6 dc 5e e1 48 89 c6 48 8d 3d 3c 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@xe_compute_preempt@compute-preempt-many-vram-evict